-- Logs begin at Mon 2022-10-03 12:49:54 UTC, end at Mon 2022-10-03 13:59:01 UTC. -- Oct 03 13:21:36.653053 dv-cinder-860090-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 13:21:36.662604 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 13:21:36 2022] *** Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: nodename: dv-cinder-860090-1-iscsi Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: machine: x86_64 Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: clock source: unix Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: pcre jit disabled Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: detected number of CPU cores: 4 Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: current working directory: / Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: detected binary path: /usr/bin/uwsgi-core Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: your processes number limit is 47680 Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: your memory page size is 4096 bytes Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: detected max file descriptor number: 2048 Oct 03 13:21:36.664655 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: lock engine: pthread robust mutexes Oct 03 13:21:36.666230 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: thunder lock: enabled Oct 03 13:21:36.666230 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 13:21:36.666230 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 13:21:36.703691 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: Python main interpreter initialized at 0x5636e79b89c0 Oct 03 13:21:36.703691 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: python threads support enabled Oct 03 13:21:36.703691 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: your server socket listen backlog is limited to 100 connections Oct 03 13:21:36.703691 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: your mercy for graceful operations on workers is 90 seconds Oct 03 13:21:36.704124 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 13:21:36.704124 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: *** Operational MODE: preforking *** Oct 03 13:21:36.704360 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: *** uWSGI is running in multiple interpreter mode *** Oct 03 13:21:36.704360 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: spawned uWSGI master process (pid: 105449) Oct 03 13:21:36.704570 dv-cinder-860090-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 03 13:21:36.706013 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: spawned uWSGI worker 1 (pid: 105450, cores: 1) Oct 03 13:21:36.706013 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: spawned uWSGI worker 2 (pid: 105451, cores: 1) Oct 03 13:21:36.706550 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 13:21:37.384949 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 13:21:37.399102 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 13:21:38.508583 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:21:38.508583 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: from cryptography.utils import int_from_bytes Oct 03 13:21:38.509400 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:21:38.509400 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: from cryptography.utils import int_from_bytes Oct 03 13:21:38.869229 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:21:38.869229 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: from cryptography.utils import int_from_bytes Oct 03 13:21:38.869903 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:21:38.869903 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: from cryptography.utils import int_from_bytes Oct 03 13:21:41.118167 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 13:21:41.118889 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 13:21:41.119035 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 13:21:41.119324 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 13:21:41.119578 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 13:21:41.119999 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.120311 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.120618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.120934 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.121273 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.121727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.122057 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.122370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.122700 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.122964 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.123280 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.123606 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860090-1-iscsi {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.123929 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.124243 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.124551 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.124870 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.125179 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.125529 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.125833 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.126337 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.126790 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.127099 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.127669 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.128019 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.128328 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.129195 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.129555 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.129859 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.130185 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.130495 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.130902 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860090-1-iscsi {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.131223 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.131541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.131913 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.132321 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.132628 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.132938 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.133261 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.133624 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.133935 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.134264 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.134586 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.134901 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.135226 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.135531 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.135841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.136149 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.136465 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.136772 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.137081 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.137330 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.137674 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.138001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.138325 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.138644 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.138897 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.139151 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.139476 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.139798 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.140112 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.140422 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.140730 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.141034 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.141340 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.141682 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.141986 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.142295 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.142608 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.142929 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.143246 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.143554 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.143872 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.144927 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.145191 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.145815 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.145952 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.146276 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.146590 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.146917 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.147277 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.147890 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.148123 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.148423 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.148864 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.149313 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.150040 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.150040 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.150424 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.150844 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.151251 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.151616 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.152027 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.152423 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.152832 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.153230 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.153654 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.154042 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.154884 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.155210 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.155527 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.155843 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.156154 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.156469 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.157423 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.157423 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.157643 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.157879 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.158191 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.158502 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.158814 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.162370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.162370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.162370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.162370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.162370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.162370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.162370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.162370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.163649 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.163649 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.163649 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.163649 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.163649 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.163649 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.164094 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.164234 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.164541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.164847 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.165154 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.165562 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.165784 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.166086 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.166408 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.166732 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.167047 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.167355 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.167663 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.167987 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.168330 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.168669 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.169029 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.169347 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.169722 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.170061 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.170384 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.170700 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.171020 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.171352 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.171667 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.171987 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.172299 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.172622 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.173015 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.173274 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.173622 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.173946 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.174263 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.174577 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.175028 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.175234 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.176137 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.176459 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.176810 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.177155 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.177509 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.177836 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.178170 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.178484 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.178798 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.179115 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.179461 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.179773 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.180085 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.180408 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.180722 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.181045 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.181351 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.181699 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.182016 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.182328 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.182640 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.182997 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.183299 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.183624 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.183953 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.184255 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.184576 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.184891 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.185205 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.185540 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.185853 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.186168 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.186475 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.186796 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.187103 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.187424 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.187758 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.188066 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.188401 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.188707 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.189027 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.189339 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.189678 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.189985 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.190300 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.190609 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.190944 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.191276 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.191589 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.192080 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.192417 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.192726 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.193036 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.193353 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.193693 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.194008 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.194323 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.194639 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.194975 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.195567 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.195567 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.195926 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.196269 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.196577 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.196903 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.197234 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.197570 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.197881 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.198194 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.198502 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.198816 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.199123 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.199434 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.199742 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.200052 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.200471 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.200647 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.200951 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.201277 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.201614 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.201923 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.202227 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.202534 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.202879 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.203187 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.203535 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.203873 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.204199 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.204527 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.204842 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.205159 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.205488 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.205813 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.206124 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.206438 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.206803 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.207296 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.207621 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.207933 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.208262 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.208575 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.209692 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.209692 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.209692 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.210040 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.210212 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.210530 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.210855 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.211168 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.211485 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.211797 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.212109 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.212419 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.212732 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.213088 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.213362 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.213711 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.214741 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.214741 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.214741 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.215039 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.215254 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.215569 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.215903 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.216240 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.216554 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.216868 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.217203 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.217541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.217856 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.218171 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.218479 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.218789 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.219112 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.219429 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.219739 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.220051 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.220364 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.220683 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.220981 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.221286 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.221617 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.221931 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.223049 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.223383 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.223725 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.224052 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.224364 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.224675 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.224997 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.225321 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.225657 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.225969 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.226275 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.226621 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.226931 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.227236 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.227562 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.227876 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.228192 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.228511 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.228830 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.229143 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.229504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.229811 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.230123 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.230436 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.230751 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.231062 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.231374 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.231693 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.232006 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.232318 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.232630 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.232936 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.233249 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.233596 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.234190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.234538 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.234855 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.235176 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.235528 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.235853 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.236190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.236520 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.236835 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.237153 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.237552 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.237844 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.238851 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.239635 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.239957 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.240277 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.240594 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.240916 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.241231 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.241570 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.241924 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.242202 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.242527 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.242843 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.243153 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.243471 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.243797 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.244122 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.244429 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.244745 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.245053 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.245401 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.245736 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.246090 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.246429 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.246777 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.247082 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.247391 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.247720 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.248030 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.248337 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.248651 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.248956 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.249266 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.249600 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.249915 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.250225 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.250536 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.250850 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.251156 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.251466 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.251775 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.252090 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.252657 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.252970 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.253273 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.253751 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.254136 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.254446 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.254759 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.255064 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.255379 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.255693 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.256069 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.256377 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.256686 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.256995 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.257302 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.257664 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.257979 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.258288 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.258594 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.258904 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.259208 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.259514 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.259823 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.260148 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.260467 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.260773 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.261087 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.261393 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.261728 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.262036 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.262344 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.262650 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.262954 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.263260 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.263564 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.263871 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.264201 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.264511 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.264817 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.265127 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.265428 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.265804 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.266109 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.266472 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.266780 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.267092 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.267416 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.267729 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.268045 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.268366 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.268675 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.268994 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.270677 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.271009 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.271327 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.271640 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.271993 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.272302 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.272621 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.272952 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.273280 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.273717 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.274030 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.274347 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.274662 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.274975 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.275297 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.275606 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.275920 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.276234 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.276550 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.276865 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.277183 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.277516 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.277834 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.278148 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.278458 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.278788 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.279099 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.279409 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.279721 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.280027 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.280338 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.280642 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.281087 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.281404 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.281745 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.282056 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.282371 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.282683 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.283003 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.283320 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.283629 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.284053 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.284367 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.285550 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.285883 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.286202 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.286363 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 13:21:41.287052 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.287209 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 13:21:41.287359 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.287491 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 13:21:41.287582 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.287686 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 13:21:41.287810 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.287896 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 13:21:41.287977 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.288057 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.288191 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.288309 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.288430 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.288617 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.288709 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.288932 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.289051 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.289264 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.289355 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.289602 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.289707 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.289925 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.290024 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.290239 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.290386 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.290569 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.290725 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.290864 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.291002 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.291160 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.291326 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.291464 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860090-1-iscsi {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.291653 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.291766 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.291980 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.292072 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.292292 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.292379 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.292611 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.292699 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.292911 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.293001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.293233 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.293321 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.293560 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.293652 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.293888 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.294066 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.294206 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.294375 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.294515 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.294679 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.294844 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.294987 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.295170 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.295322 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.295492 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.295624 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.295814 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.295911 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.296226 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.296313 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.296529 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.296627 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.296848 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.296937 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.297157 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.297262 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.297509 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.297600 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860090-1-iscsi {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.297823 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.297911 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.298132 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.298226 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.298443 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.298527 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.298752 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.298896 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.299059 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.299181 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.299385 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.299524 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.299696 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.299853 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.300002 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.300153 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.300334 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.300481 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.300624 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.300767 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.300916 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.301040 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.301232 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.301389 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.301591 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.301929 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.302080 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.302214 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.302353 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.302491 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.302627 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.302779 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.302916 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.303023 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.303136 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.303265 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.303440 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.303540 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.303693 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.303841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.303982 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.304119 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.304306 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.304448 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.304653 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.304751 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.304940 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.305059 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.305251 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.305340 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.305411 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.305736 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.305897 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.306069 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.306206 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.306374 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.306516 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.306684 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.306818 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.306984 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.307074 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.307311 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.307476 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.307616 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.307771 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.307926 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.308061 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.308184 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.308272 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.308470 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.308618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.308787 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.308891 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.309099 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.309193 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.309417 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.309541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.309743 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.309832 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.310061 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.310157 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.310399 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.310495 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.310697 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.310785 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.311002 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.311094 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.311308 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.311422 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.311612 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.311702 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.311918 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.312006 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.312235 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.312331 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.312543 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.312630 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.312843 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.312941 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.313147 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.313247 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.313496 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.313588 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.313787 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.313877 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.314096 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.314194 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.314407 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.314494 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.314659 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.314746 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.314957 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.315075 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.315267 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.315454 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.315584 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.315671 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.315901 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.316006 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.316219 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.316374 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.316514 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.316672 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.316833 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.316978 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.317222 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.317337 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.317557 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.317669 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.317864 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.317961 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.318172 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.318285 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.318475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.318639 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.318790 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.318885 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.319093 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.319181 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.319396 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.319664 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.319753 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.319987 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.320082 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.320309 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.320408 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.320622 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.320724 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.320928 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.321043 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.321234 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.321422 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.321582 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.321705 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.321856 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.321950 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.322178 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.322278 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.322482 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.322571 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.322785 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.322884 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.323107 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.323204 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.323413 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.323552 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.323717 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.323891 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.324037 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.324234 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.324346 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.324560 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.324648 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.324885 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.324996 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.325204 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.325304 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.325554 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.325646 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.325872 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.325981 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.326178 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.326268 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.326482 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.326587 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.326783 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.326881 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.327087 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.327183 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.327386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.327484 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.327689 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.327783 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.327989 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.328085 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.328289 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.328388 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.328592 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.328681 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.328913 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.329066 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.329216 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.329308 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.329545 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.329644 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.329852 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.329953 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.330156 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.330251 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.330472 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:21:41.330570 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.330807 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.330913 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.331127 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.331242 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.334593 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.334779 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.334907 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.335019 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.335129 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.335248 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.335248 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.335478 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.335604 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.335714 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.335821 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.336010 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.336128 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.336235 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.336349 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.336457 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.336574 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.337255 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.337344 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.337426 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.337568 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.337718 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.337810 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.337893 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.337987 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338070 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338157 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338248 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338343 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338426 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338506 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338586 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338665 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338754 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338836 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.338923 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339006 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339093 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339163 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339240 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339310 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339310 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339464 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339630 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339630 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339786 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339786 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.339932 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.340076 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.340256 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.340399 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.340502 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.340710 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.340798 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.341023 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.341122 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.341333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.341423 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.341671 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.341762 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.341994 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.342084 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.342310 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.342397 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.342619 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.342696 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.342929 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.343009 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.343247 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.343326 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.343559 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.343650 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346328 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346464 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346464 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346592 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346660 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346726 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346821 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346892 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.346892 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.347012 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.347079 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.347155 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.347928 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348065 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348155 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348226 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348294 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348372 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348442 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348518 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348599 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348668 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348736 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348811 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348880 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348946 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.348946 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349066 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349159 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349236 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349305 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349521 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349601 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349888 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.349985 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.350294 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.350385 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.350512 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.350590 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.350841 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.350918 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353241 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353362 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353439 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353573 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353663 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353736 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353804 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353871 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.353871 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354011 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354090 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354167 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354237 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354313 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354383 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354457 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354540 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354609 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354676 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354676 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354796 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354872 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.354941 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.355007 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.355082 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.355158 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.355226 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.355471 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.355569 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.355778 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.355874 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.356038 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.356150 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.356322 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.356412 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.356635 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.356730 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.356946 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.357034 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.357275 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.357364 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.357613 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.357718 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.357928 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.358025 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.358266 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.358361 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.358577 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.358663 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.358890 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.358989 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.359203 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.359300 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.359516 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.359603 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.359827 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.359928 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.360130 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.360223 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.360450 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.360628 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.360790 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.360932 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.361079 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.361241 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.361442 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.361629 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.361774 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.361928 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.362056 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.362178 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.362314 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.362445 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.362582 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.362708 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.362879 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.363001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.363135 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.363267 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.363507 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.363639 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.363813 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.363952 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.364151 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.364484 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.364626 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.364783 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.364935 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.365076 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.365213 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.365359 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.365517 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.365608 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.365678 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.365998 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.366133 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.366317 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.366459 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.366643 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.366790 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.366956 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.367119 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.367270 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.367438 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.367580 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.367769 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.367892 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.368102 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.368242 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.368422 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.368519 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.368748 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.368835 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.369064 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.369153 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.369402 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.369583 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.369739 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.369849 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.370063 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.370185 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.370374 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.370525 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.370715 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.370860 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.371010 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.371136 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.371273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.371432 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.371647 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.371754 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.371942 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.372058 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.372262 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.372371 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.372582 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.372670 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.372891 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.372988 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.373205 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.373294 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.373544 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.373697 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.373833 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.374097 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.374248 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.374343 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.374424 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.374514 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.374742 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.374840 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.375048 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.375136 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.375355 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.375442 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.375661 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.375758 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.375969 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.376055 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.376278 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.376363 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.376583 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.376670 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.376884 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.376969 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.377192 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.377281 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.377793 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.377903 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.378127 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.378229 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.378711 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.378869 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.379102 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.379319 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.379667 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.379763 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.380011 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.380097 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.380334 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.380422 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.380667 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.380751 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.380987 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.381096 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.381296 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.381383 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.381638 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.381727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.381960 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.382064 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.382275 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.382506 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.382601 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.382882 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.383027 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.383199 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.383512 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.383597 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.383820 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.384115 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.384200 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.384429 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.384716 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.384804 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.385059 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.385161 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.385385 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.385701 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.385803 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.386030 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.386255 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.386350 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.386652 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.386821 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.386965 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.387274 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.387360 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.387583 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.387679 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.387888 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.388023 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.388233 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.388350 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.388544 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.388693 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.388850 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.389030 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.389162 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.389372 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.389587 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.389745 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.389891 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.390069 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.390205 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.390411 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.390555 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.390696 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.390823 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.391029 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.391173 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.391341 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.391496 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.391652 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.391787 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.391963 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.392107 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.392278 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.392414 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.392589 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.392724 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.392898 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.393032 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.393220 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.393360 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.393542 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.393691 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.393849 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.394542 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.394894 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.395041 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.395165 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.395296 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.395468 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.395614 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.395797 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.395885 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.396153 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.396420 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.396497 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.396759 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.396844 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.397077 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.397162 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.397400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.397512 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.397774 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.397864 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.398094 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.398194 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.398387 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 13:21:41.398474 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.398729 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.399046 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.399357 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.399676 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.399986 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.400293 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.400606 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.400912 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.401216 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.401543 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.401856 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.402162 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.402467 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.402770 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.403073 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.403387 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.403692 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.404002 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.404305 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.404630 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.404950 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.405249 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.405692 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.406005 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.406356 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.406659 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.407011 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.407340 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.407685 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.408131 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.408395 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.408670 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.408922 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.409309 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.409674 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.410529 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.410873 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.411195 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.411544 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.411854 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.412166 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.412475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.412779 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.413088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.413395 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.413737 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.414050 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.414354 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.414655 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.414967 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.415279 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.415580 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.415894 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.416194 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.416512 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.416815 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.417119 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.417420 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.417752 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.418061 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.418370 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.418700 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.419012 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.419317 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.419627 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.419935 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.420243 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.420546 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.420856 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.421179 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.421518 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.421828 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.422137 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.422444 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.422753 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.423055 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.423361 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.423665 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.423970 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.424269 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.424571 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.424874 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.425204 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.425580 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.425888 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.426194 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.426498 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.426843 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.427146 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.427508 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.427813 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.428128 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.428448 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.428758 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.429069 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.429383 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.429767 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.430030 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.430342 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.430657 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.430960 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.431264 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.431589 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.431899 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.432210 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.432538 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.432862 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.433191 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.433516 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.433832 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.434147 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.434453 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.434766 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.435075 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.435389 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.435705 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.436021 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.436331 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.436644 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.436950 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.437262 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.437598 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.437908 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.438243 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.438554 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.438862 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.439170 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.439482 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.439794 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.440100 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.440558 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.440895 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.441221 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.441555 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.441871 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.442193 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.442518 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.442844 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.443152 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.443602 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.443918 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.444232 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.444545 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.444857 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.445163 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.445499 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.445839 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.446151 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.446460 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.446767 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.447093 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.447398 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.447721 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.448159 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.448476 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.448784 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.449208 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.449543 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.449859 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.450186 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.450512 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.450841 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.451152 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.451472 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.451784 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.452109 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.452479 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.452755 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.453074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.453379 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.453736 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.454064 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.454383 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.454706 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.455146 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.455474 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.455789 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.456114 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.456445 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.457376 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.457718 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.458040 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.458350 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.458659 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.458992 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.459299 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.459609 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.459925 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.460237 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.460541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.460849 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.461176 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.461517 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.461831 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.462151 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.462477 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.462804 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.463109 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.463432 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.463742 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.464048 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.464356 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.464660 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.465008 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.465315 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.465665 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.466004 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.466337 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.466653 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.466991 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.467324 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.467648 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.467962 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.468283 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.468612 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.468918 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.469225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.469564 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.469877 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.470184 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.470491 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.470800 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.471106 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.471412 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.471717 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.472050 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.473157 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.473518 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.473838 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.474146 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.474454 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.474759 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.475110 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.475418 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.475752 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.476064 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.476392 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.476712 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.477054 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.477349 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.477695 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.478013 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.478331 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.478647 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.478958 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.479275 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.479592 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.479913 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.480507 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.480838 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.481162 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.481504 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.481824 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.482142 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.482462 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.482778 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.483095 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.483405 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.483721 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.484053 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.484380 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.484712 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.485509 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.485509 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.485509 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.485509 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.485509 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.485509 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.485509 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.489836 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.489836 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.489836 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.489836 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.489836 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.489836 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.490479 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.490479 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.490479 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.490796 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.491111 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.491427 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.491762 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.492104 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.492429 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.492783 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.493075 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.493388 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.493993 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.494311 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.494653 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.494981 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.495309 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.495629 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.495950 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.496284 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.496596 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.496908 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.497224 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.497564 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.497873 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.498200 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.498511 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.498822 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.499149 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.499458 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.500066 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.500420 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.500736 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.501066 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.501391 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.501740 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.502055 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.502381 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.502954 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.503266 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.503658 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.503974 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.504281 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.504595 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.504911 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.505222 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.505556 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.505870 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.506176 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.506506 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.506815 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.507122 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.507427 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.507740 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.508046 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.508351 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.508661 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.508968 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.509286 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.509624 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.509948 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.510255 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.510575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.510931 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.511244 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.511555 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.511890 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.512196 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.512503 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.512826 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.513139 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.513523 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.513803 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.514117 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.514473 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.514794 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.515386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.515725 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.516047 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.516391 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.516724 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.517033 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.517342 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.517676 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.518002 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.518316 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.518630 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.518941 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.519870 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.520178 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.520495 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.520809 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.521119 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.521442 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.521778 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.522092 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.522404 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.522718 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.523030 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.523353 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.523712 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.524035 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.524354 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.524673 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.524990 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.525304 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.525645 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.525961 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.526274 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.526592 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.526926 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.527241 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.527547 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.528273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.528615 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.528945 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.529275 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.529619 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.529952 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.530284 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.530608 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.530934 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.531250 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.531586 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.531931 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.532268 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.532599 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.532911 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.533222 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.533603 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.533879 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.534200 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.534514 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.534881 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.535188 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.535508 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.535816 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.536124 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.536428 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.536734 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.537044 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.537349 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.537681 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.537986 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.538290 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.538603 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.538902 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.539213 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.539518 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.539823 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.540127 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.540433 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.540743 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.541080 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.541412 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.541754 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.542081 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.542395 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.542721 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.543031 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.543355 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.543684 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.544005 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.544316 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.544651 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.544964 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.545277 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.545620 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.545934 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.546247 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.546560 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.546891 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.547220 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.547529 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.547857 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.548178 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.548505 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.548819 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.549131 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.549489 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.549796 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.550110 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.551086 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.551397 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.551713 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.552032 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.552344 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.552657 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.552977 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.553296 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.553400 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Registered counter for database nova_api Oct 03 13:21:41.553653 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.553983 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.554297 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.554624 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.554955 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.555308 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.555627 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.555970 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.556301 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.556618 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.556931 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.557238 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:21:41.557508 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 13:21:41.575649 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:21:41.583388 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:21:41.646741 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.context [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4538db60-5857-474d-9312-77364756bb5d(cell1) {{(pid=105451) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 13:21:41.650789 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:21:41.651282 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:21:41.652926 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:21:41.653766 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:21:41.654224 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:21:41.656321 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:21:41.658505 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Registered counter for database nova_cell0 Oct 03 13:21:41.663058 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Registered counter for database nova_cell1 Oct 03 13:21:41.670774 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:21:41.673103 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:21:41.677697 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:21:41.683959 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:21:41.711095 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Registered counter for database nova_api Oct 03 13:21:41.731189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:21:41.738100 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:21:41.797174 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.context [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4538db60-5857-474d-9312-77364756bb5d(cell1) {{(pid=105450) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 13:21:41.801136 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:21:41.801652 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:21:41.803223 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:21:41.803958 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:21:41.804399 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:21:41.806449 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:21:41.808462 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Registered counter for database nova_cell0 Oct 03 13:21:41.812562 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Registered counter for database nova_cell1 Oct 03 13:21:41.820603 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:21:41.824244 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:21:41.826791 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:21:41.832934 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Registered counter for database nova_cell0 Oct 03 13:21:41.844691 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:21:41.851251 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:21:41.973788 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:21:41.984500 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Registered counter for database nova_cell0 Oct 03 13:21:41.995280 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:21:42.000690 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:21:42.204119 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 13:21:42.212374 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 13:21:42.325568 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 13:21:42.333748 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 13:21:42.565187 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 13:21:42.572274 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 13:21:42.578103 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636e79b89c0 pid: 105451 (default app) Oct 03 13:21:42.580316 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:21:42.582172 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001940 Oct 03 13:21:42.582814 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Mon Oct 3 13:21:42 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:21:42.683000 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 13:21:42.689555 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-02c6b9f3-5730-48ef-83a2-cdb48534bdba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 13:21:42.696819 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636e79b89c0 pid: 105450 (default app) Oct 03 13:23:11.971056 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:11.972068 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Oct 03 13:23:11.974270 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:11.991872 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:11.992898 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell0:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:11.994020 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell1:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:11.994890 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell0:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:13.360243 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-fd175a57-fafa-4ef8-b11b-e01a94ea68ce admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:13.399615 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-fd175a57-fafa-4ef8-b11b-e01a94ea68ce admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.418851 Oct 03 13:23:13.400814 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Oct 3 13:23:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:23:16.318741 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:16.318741 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-6f4f0dab-2c40-4939-a66e-4a285f322a22 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 03 13:23:16.325673 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:23:16.889744 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-9e6a1f38-fcbc-4860-9d7f-dbebecd2874c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "ram": 256, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:16.946825 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-9e6a1f38-fcbc-4860-9d7f-dbebecd2874c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.620627 Oct 03 13:23:16.947411 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:23:17.175872 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a4552f88-dfe9-48ba-a8ea-40a8588b80a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:17.207170 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:17.208898 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell1:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:17.209750 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:17.210997 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:17.292429 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a4552f88-dfe9-48ba-a8ea-40a8588b80a1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.334923 Oct 03 13:23:17.293475 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 3 13:23:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:23:20.069660 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-9e6a1f38-fcbc-4860-9d7f-dbebecd2874c admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:20.070923 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-9e6a1f38-fcbc-4860-9d7f-dbebecd2874c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001759 Oct 03 13:23:20.071612 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:20.867595 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-f65bf857-74ad-47d2-9e7c-f36d033a35bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "ds512M"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:20.943408 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-f65bf857-74ad-47d2-9e7c-f36d033a35bf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.864567 Oct 03 13:23:20.944497 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:23:20.956664 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-3eea3b1d-646f-40e0-a3ed-44baa6aff8f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:21.006716 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-3eea3b1d-646f-40e0-a3ed-44baa6aff8f7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054151 Oct 03 13:23:21.017172 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 3 13:23:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:23:23.753058 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-f65bf857-74ad-47d2-9e7c-f36d033a35bf admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:23.754104 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-f65bf857-74ad-47d2-9e7c-f36d033a35bf admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001749 Oct 03 13:23:23.754518 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:24.244860 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-6b4d82a6-ab45-4019-ad4a-2ab711184e3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:24.269910 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-6b4d82a6-ab45-4019-ad4a-2ab711184e3e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.508407 Oct 03 13:23:24.270389 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:23:24.290976 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-268bd1f5-5ef7-440b-b9ff-91a4aafc165d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:24.334829 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-268bd1f5-5ef7-440b-b9ff-91a4aafc165d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050517 Oct 03 13:23:24.337616 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 3 13:23:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:23:27.667608 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-6b4d82a6-ab45-4019-ad4a-2ab711184e3e admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:27.669759 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-6b4d82a6-ab45-4019-ad4a-2ab711184e3e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002938 Oct 03 13:23:27.671170 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:28.270432 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-dc757f93-203a-4d74-814e-7172ea99b6fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:28.294456 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-dc757f93-203a-4d74-814e-7172ea99b6fe admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.611683 Oct 03 13:23:28.295642 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:23:28.309972 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-e2cd4d78-dc16-479c-8f2d-ad4aaafdf4b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:28.344149 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-e2cd4d78-dc16-479c-8f2d-ad4aaafdf4b0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038327 Oct 03 13:23:28.345218 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 3 13:23:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:23:31.401103 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-dc757f93-203a-4d74-814e-7172ea99b6fe admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:31.402147 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-dc757f93-203a-4d74-814e-7172ea99b6fe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 03 13:23:31.402609 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:32.103794 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c13e2907-06cb-4a7a-bf82-f9268652a2cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "name": "ds4G"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:32.131708 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c13e2907-06cb-4a7a-bf82-f9268652a2cc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.719680 Oct 03 13:23:32.132762 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:23:32.148370 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-80f67165-71b9-40cb-b24f-c0d5567a17cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:32.182300 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-80f67165-71b9-40cb-b24f-c0d5567a17cf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038843 Oct 03 13:23:32.182920 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Mon Oct 3 13:23:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:23:35.446765 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c13e2907-06cb-4a7a-bf82-f9268652a2cc admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:35.448682 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c13e2907-06cb-4a7a-bf82-f9268652a2cc admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002640 Oct 03 13:23:35.449421 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:35 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:36.023297 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-12ae2f03-9b30-4f69-a570-dc781b88d576 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:36.060824 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-12ae2f03-9b30-4f69-a570-dc781b88d576 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.604033 Oct 03 13:23:36.061937 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Oct 3 13:23:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:23:38.991571 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c13e2907-06cb-4a7a-bf82-f9268652a2cc admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:38.992854 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c13e2907-06cb-4a7a-bf82-f9268652a2cc admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001814 Oct 03 13:23:38.993272 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:39.499431 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-bf93bfac-af3d-4e9d-9b15-d2dde158b929 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "name": "m1.tiny", "id": "1"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:39.522502 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-bf93bfac-af3d-4e9d-9b15-d2dde158b929 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.520810 Oct 03 13:23:39.523391 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:23:39.535422 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-90bab555-9857-451f-8cfd-3a0f6912c473 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:39.572680 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-90bab555-9857-451f-8cfd-3a0f6912c473 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041063 Oct 03 13:23:39.573995 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 3 13:23:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:23:42.280855 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-bf93bfac-af3d-4e9d-9b15-d2dde158b929 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:42.281997 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-bf93bfac-af3d-4e9d-9b15-d2dde158b929 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Oct 03 13:23:42.282445 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:42.701740 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c35d47c6-3cf0-4864-85f5-1b8cb29ccf6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "swap": 0, "ram": 2048, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:42.708120 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:42.725270 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c35d47c6-3cf0-4864-85f5-1b8cb29ccf6a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.436770 Oct 03 13:23:42.728571 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 13:23:42.739441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-f3b5ce76-e01b-4aac-873b-942cd9f0b051 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:42.764292 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-f3b5ce76-e01b-4aac-873b-942cd9f0b051 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028530 Oct 03 13:23:42.765094 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 3 13:23:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:23:45.574209 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c35d47c6-3cf0-4864-85f5-1b8cb29ccf6a admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:45.575467 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c35d47c6-3cf0-4864-85f5-1b8cb29ccf6a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 03 13:23:45.576233 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:46.190211 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-795d2c36-376d-43ca-b24f-0ed730fc86d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:46.213297 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-795d2c36-376d-43ca-b24f-0ed730fc86d2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.630055 Oct 03 13:23:46.213814 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 13:23:46.227391 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-d3503373-c012-49fe-a145-8d0def3a07f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:46.254822 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-d3503373-c012-49fe-a145-8d0def3a07f3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031101 Oct 03 13:23:46.255806 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 3 13:23:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:23:48.949949 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-795d2c36-376d-43ca-b24f-0ed730fc86d2 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:48.951061 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-795d2c36-376d-43ca-b24f-0ed730fc86d2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 03 13:23:48.951478 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:49.419108 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-49410d88-b17b-4bd8-9a71-09b131e0e243 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "4", "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:49.446240 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-49410d88-b17b-4bd8-9a71-09b131e0e243 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.487462 Oct 03 13:23:49.446822 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:23:49.459694 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-431c9e63-2d2f-4ac9-b477-27eeedeb976e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:49.471281 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:23:49.494546 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-431c9e63-2d2f-4ac9-b477-27eeedeb976e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038655 Oct 03 13:23:49.495148 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 3 13:23:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:23:52.227054 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-49410d88-b17b-4bd8-9a71-09b131e0e243 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:23:52.228081 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-49410d88-b17b-4bd8-9a71-09b131e0e243 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 03 13:23:52.228490 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:23:52.701263 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-54c420f0-d99f-40fb-bcd2-1a8e7fbe04a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "id": "5", "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:52.727606 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-54c420f0-d99f-40fb-bcd2-1a8e7fbe04a0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.492069 Oct 03 13:23:52.728750 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Mon Oct 3 13:23:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:23:52.741304 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-34a607b6-c90a-4ee6-b853-09ff3ffac033 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:23:52.775371 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-34a607b6-c90a-4ee6-b853-09ff3ffac033 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037923 Oct 03 13:23:52.775957 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Mon Oct 3 13:23:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:24:08.880590 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-54c420f0-d99f-40fb-bcd2-1a8e7fbe04a0 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:08.881527 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-54c420f0-d99f-40fb-bcd2-1a8e7fbe04a0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 03 13:24:08.881946 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:08.893902 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:09.298071 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-204a40c0-a805-46c9-9420-c361385c5aec admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:09.317185 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-204a40c0-a805-46c9-9420-c361385c5aec admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.428830 Oct 03 13:24:09.317774 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Oct 3 13:24:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:24:10.674319 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-54c420f0-d99f-40fb-bcd2-1a8e7fbe04a0 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:10.675356 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-54c420f0-d99f-40fb-bcd2-1a8e7fbe04a0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Oct 03 13:24:10.675757 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:11.219685 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-fdb8136c-979f-43f0-9472-697ad544bd07 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:11.225055 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-fdb8136c-979f-43f0-9472-697ad544bd07 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-fdb8136c-979f-43f0-9472-697ad544bd07 admin admin] Request method failure captured: Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Accept: application/json Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Connection: keep-alive Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Content-Length: 0 Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Host: 10.222.0.58 Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjOuJ6THt8xgATq5Kx1xdtfZ43cAQYWQ-AxcXmEILvkH2SVzkgnW62lqbdjvsLv0FUaZVn28VuGzyCOcP6FR6zmhvByu7AnZXToV6kqP7JqVNoSVwm9q1A59w7JlOPVSKknX3FWsoOcDFfFtPpyl-jHVrQ8OXKRe0IwmhPQ9vlhRGmhpo Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Role: reader,member,admin Oct 03 13:24:11.228386 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Roles: reader,member,admin Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant: admin Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User: admin Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Id: 72593536090c47589cfad801ff3da440 Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Name: admin Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: method: > Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: exception: Flavor 42 could not be found. Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: action_args: {'id': '42'} Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:24:11.230074 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:11.231088 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.232400 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-fdb8136c-979f-43f0-9472-697ad544bd07 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:24:11.233626 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-fdb8136c-979f-43f0-9472-697ad544bd07 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.409883 Oct 03 13:24:11.233626 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Oct 3 13:24:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 13:24:11.240310 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-25789b81-fe97-4218-9055-1d3caf522445 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:11.244556 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:24:11.264103 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-25789b81-fe97-4218-9055-1d3caf522445 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027438 Oct 03 13:24:11.264678 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 3 13:24:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:24:11.276051 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-d51060c5-1913-4f49-977f-baa943ce2517 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:11.298757 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-d51060c5-1913-4f49-977f-baa943ce2517 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027151 Oct 03 13:24:11.299328 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 3 13:24:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:24:11.309130 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-0d72f9f6-82b2-4008-a8b3-d404deef4995 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:11.315345 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-0d72f9f6-82b2-4008-a8b3-d404deef4995 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-0d72f9f6-82b2-4008-a8b3-d404deef4995 admin admin] Request method failure captured: Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Accept: application/json Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Connection: keep-alive Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Content-Length: 0 Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Host: 10.222.0.58 Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjOuJ6THt8xgATq5Kx1xdtfZ43cAQYWQ-AxcXmEILvkH2SVzkgnW62lqbdjvsLv0FUaZVn28VuGzyCOcP6FR6zmhvByu7AnZXToV6kqP7JqVNoSVwm9q1A59w7JlOPVSKknX3FWsoOcDFfFtPpyl-jHVrQ8OXKRe0IwmhPQ9vlhRGmhpo Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Role: reader,member,admin Oct 03 13:24:11.318623 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Roles: reader,member,admin Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant: admin Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User: admin Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Id: 72593536090c47589cfad801ff3da440 Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Name: admin Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: method: > Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: exception: Flavor 42 could not be found. Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: action_args: {'id': '42'} Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:24:11.320190 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:11.321376 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:11.322727 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-0d72f9f6-82b2-4008-a8b3-d404deef4995 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:24:11.323983 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-0d72f9f6-82b2-4008-a8b3-d404deef4995 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014783 Oct 03 13:24:11.323983 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Oct 3 13:24:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 03 13:24:12.584962 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-d51060c5-1913-4f49-977f-baa943ce2517 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:12.586119 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-d51060c5-1913-4f49-977f-baa943ce2517 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Oct 03 13:24:12.586516 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:13.141569 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-9404e080-a3a8-4c82-a059-870dc31007ca admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:13.146677 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-9404e080-a3a8-4c82-a059-870dc31007ca admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-9404e080-a3a8-4c82-a059-870dc31007ca admin admin] Request method failure captured: Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Accept: application/json Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Connection: keep-alive Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Content-Length: 0 Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Host: 10.222.0.58 Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjOuJ8yi7YpxyR5DMWkyk2EfVpz82w0XT8AtkO_iKqZXcoXoqdlFNewtwgQuprrC7n47SlvT_J4ZcfbfKXFrCZ5UhxMNIsXyEzhdpsGpM-RFx4RGPBrdMOANUs7PdFL3RlLHb-lORhKzX1gumelgmUyWbC1frRu1ofUGiaP9ucBWiSVqs Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Role: reader,member,admin Oct 03 13:24:13.148182 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Roles: reader,member,admin Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant: admin Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User: admin Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Id: 72593536090c47589cfad801ff3da440 Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Name: admin Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: method: > Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: exception: Flavor 84 could not be found. Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: action_args: {'id': '84'} Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:24:13.149618 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:13.150441 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-9404e080-a3a8-4c82-a059-870dc31007ca admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:24:13.152768 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-9404e080-a3a8-4c82-a059-870dc31007ca admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.419372 Oct 03 13:24:13.152768 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Oct 3 13:24:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:13.160063 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-110050a3-e5db-4766-8d3b-a05a2aaa9cef admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:13.175699 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-110050a3-e5db-4766-8d3b-a05a2aaa9cef admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019170 Oct 03 13:24:13.176259 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 3 13:24:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:24:13.185951 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-c58cef2a-5a97-46ad-810a-b1da313ccf50 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:13.201472 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-c58cef2a-5a97-46ad-810a-b1da313ccf50 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019067 Oct 03 13:24:13.202036 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 3 13:24:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:24:13.211528 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-34012065-8e55-42f3-b439-3f733528b572 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:13.216539 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-34012065-8e55-42f3-b439-3f733528b572 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-34012065-8e55-42f3-b439-3f733528b572 admin admin] Request method failure captured: Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Accept: application/json Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Connection: keep-alive Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Content-Length: 0 Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Host: 10.222.0.58 Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjOuJ8yi7YpxyR5DMWkyk2EfVpz82w0XT8AtkO_iKqZXcoXoqdlFNewtwgQuprrC7n47SlvT_J4ZcfbfKXFrCZ5UhxMNIsXyEzhdpsGpM-RFx4RGPBrdMOANUs7PdFL3RlLHb-lORhKzX1gumelgmUyWbC1frRu1ofUGiaP9ucBWiSVqs Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Role: reader,member,admin Oct 03 13:24:13.218671 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Roles: reader,member,admin Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant: admin Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User: admin Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Id: 72593536090c47589cfad801ff3da440 Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Name: admin Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: method: > Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: exception: Flavor 84 could not be found. Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: action_args: {'id': '84'} Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:24:13.220475 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:13.221333 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:13.222541 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-34012065-8e55-42f3-b439-3f733528b572 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:24:13.223602 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-34012065-8e55-42f3-b439-3f733528b572 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012121 Oct 03 13:24:13.223602 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Mon Oct 3 13:24:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:14.492173 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-c58cef2a-5a97-46ad-810a-b1da313ccf50 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:14.493222 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-c58cef2a-5a97-46ad-810a-b1da313ccf50 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 03 13:24:14.493646 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:15.060395 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-8c6fce19-d376-4091-bb85-62e76d7e6acc admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:15.067070 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-8c6fce19-d376-4091-bb85-62e76d7e6acc admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-8c6fce19-d376-4091-bb85-62e76d7e6acc admin admin] Request method failure captured: Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Accept: application/json Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Connection: keep-alive Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Content-Length: 0 Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Host: 10.222.0.58 Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjOuJ-yL4V00VhBkRtRjI9nnLWi-wigJPxwajJdpjTYPYQOqDezEXVBgKBua5EIdcNPWGLl-6yq6cYSJaMIpKv2nQ3j5GGAHr7ruHFsIUnG6BlTU4qSfR7XY2UI7b9U9XnP2iF1JjkuCeFq71rILPF7gGfLPm6JUsJOUaOooeKld8Wi0Y Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Role: reader,member,admin Oct 03 13:24:15.068575 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Roles: reader,member,admin Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant: admin Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User: admin Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Id: 72593536090c47589cfad801ff3da440 Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: X-User-Name: admin Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: method: > Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: exception: Flavor 451 could not be found. Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: action_args: {'id': '451'} Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:24:15.070225 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:15.071189 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.072273 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-8c6fce19-d376-4091-bb85-62e76d7e6acc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:24:15.073321 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-8c6fce19-d376-4091-bb85-62e76d7e6acc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.435732 Oct 03 13:24:15.073321 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 3 13:24:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:15.079870 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-76fd1f35-5290-4c8b-96a1-cda3efbe9962 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:15.094728 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-76fd1f35-5290-4c8b-96a1-cda3efbe9962 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018343 Oct 03 13:24:15.095263 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 3 13:24:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:24:15.105239 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:15.121075 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019459 Oct 03 13:24:15.121699 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Mon Oct 3 13:24:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:24:15.133014 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a46dbaf2-6803-40c5-ad61-1308c4577a4c admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:15.138383 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-a46dbaf2-6803-40c5-ad61-1308c4577a4c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a46dbaf2-6803-40c5-ad61-1308c4577a4c admin admin] Request method failure captured: Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Accept: application/json Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Connection: keep-alive Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Content-Length: 0 Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Host: 10.222.0.58 Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjOuJ-yL4V00VhBkRtRjI9nnLWi-wigJPxwajJdpjTYPYQOqDezEXVBgKBua5EIdcNPWGLl-6yq6cYSJaMIpKv2nQ3j5GGAHr7ruHFsIUnG6BlTU4qSfR7XY2UI7b9U9XnP2iF1JjkuCeFq71rILPF7gGfLPm6JUsJOUaOooeKld8Wi0Y Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Role: reader,member,admin Oct 03 13:24:15.140001 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Roles: reader,member,admin Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf1b6fdf131f4a598a5705727a85c56c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant: admin Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant-Id: cf1b6fdf131f4a598a5705727a85c56c Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User: admin Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Id: 72593536090c47589cfad801ff3da440 Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: X-User-Name: admin Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: method: > Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: exception: Flavor 451 could not be found. Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: action_args: {'id': '451'} Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:24:15.141541 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:15.142504 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Oct 03 13:24:15.143841 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a46dbaf2-6803-40c5-ad61-1308c4577a4c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:24:15.145076 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a46dbaf2-6803-40c5-ad61-1308c4577a4c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012154 Oct 03 13:24:15.145076 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 3 13:24:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 03 13:24:16.409370 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:16.410493 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Oct 03 13:24:16.411234 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:16.975500 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-1be911aa-06c5-4d39-8880-b89b24af1d6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:24:16.995149 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-1be911aa-06c5-4d39-8880-b89b24af1d6c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.438306 Oct 03 13:24:16.995695 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Oct 3 13:24:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:24:18.254845 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:18.255853 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 03 13:24:18.256250 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:24:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:18.839263 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-3d738e5c-4a0b-4d1b-b51d-e082a6e28d7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:24:18.857924 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-3d738e5c-4a0b-4d1b-b51d-e082a6e28d7b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.459266 Oct 03 13:24:18.858399 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Oct 3 13:24:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:24:20.127091 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:20.128401 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 03 13:24:20.128802 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:20.687688 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-89b953eb-ffbf-40db-8fa3-fab81d7f41ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:24:20.707470 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-89b953eb-ffbf-40db-8fa3-fab81d7f41ff admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.437134 Oct 03 13:24:20.708027 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Oct 3 13:24:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:24:21.956660 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:21.957734 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 03 13:24:21.958162 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:24:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:22.509536 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-d0b85d9a-ee46-4c9b-a21d-38fa167e30c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:24:22.528821 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-d0b85d9a-ee46-4c9b-a21d-38fa167e30c5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.433296 Oct 03 13:24:22.529371 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Mon Oct 3 13:24:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:24:23.794353 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:23.795365 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 03 13:24:23.795771 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:24:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:24:24.326824 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-fd4fb3cf-9101-4014-940d-0a9154dd7e26 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:24:24.350874 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-fd4fb3cf-9101-4014-940d-0a9154dd7e26 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.418501 Oct 03 13:24:24.351857 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Mon Oct 3 13:24:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:25:22.937534 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:25:22.938544 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a9a9cf3a-9a8f-44fc-ad79-5e75cf872660 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Oct 03 13:25:22.938951 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Mon Oct 3 13:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:25:22.950503 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:23.429108 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-073214f0-93fc-4dd9-91e2-29f10484f68a admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:25:23.450620 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-073214f0-93fc-4dd9-91e2-29f10484f68a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.504622 Oct 03 13:25:23.451256 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Mon Oct 3 13:25:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:25:23.472561 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=14 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:25:23.476686 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-77d8d444-5e5e-4972-96ca-46fcd6e37f89 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:25:23.485190 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-77d8d444-5e5e-4972-96ca-46fcd6e37f89 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013975 Oct 03 13:25:23.485803 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Mon Oct 3 13:25:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:25:23.498869 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-46cb5565-fccd-41ed-87ff-dcb6ab08ec87 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:25:23.506759 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-46cb5565-fccd-41ed-87ff-dcb6ab08ec87 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012386 Oct 03 13:25:23.507579 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Mon Oct 3 13:25:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:25:23.520126 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:25:23.528469 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012286 Oct 03 13:25:23.529241 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Mon Oct 3 13:25:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:25:23.542473 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-4b49b98f-9798-405f-9330-480628f58c29 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:25:23.551703 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-4b49b98f-9798-405f-9330-480628f58c29 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013264 Oct 03 13:25:23.552273 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Mon Oct 3 13:25:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:28:27.295751 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:28:27.296753 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 03 13:28:27.297176 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:28:27.437675 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=6 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:27.601948 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-88a2411c-8906-47e8-9c02-02a84fc58d37 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:28:27.606802 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-88a2411c-8906-47e8-9c02-02a84fc58d37 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:28:27.607344 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-88a2411c-8906-47e8-9c02-02a84fc58d37 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:28:27.607699 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-88a2411c-8906-47e8-9c02-02a84fc58d37 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:28:27.608405 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-88a2411c-8906-47e8-9c02-02a84fc58d37 admin admin] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:28:27.608847 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-88a2411c-8906-47e8-9c02-02a84fc58d37 admin admin] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:28:27.609259 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-88a2411c-8906-47e8-9c02-02a84fc58d37 admin admin] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:28:27.642382 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-88a2411c-8906-47e8-9c02-02a84fc58d37 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.205921 Oct 03 13:28:27.642954 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 3 13:28:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:28:28.755456 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:28:28.756466 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 03 13:28:28.756871 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:28:28.949817 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-47a8e284-7eb2-4adc-9eb6-a1bd1e9127b7 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:28:28.954265 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-47a8e284-7eb2-4adc-9eb6-a1bd1e9127b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:28:28.954731 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-47a8e284-7eb2-4adc-9eb6-a1bd1e9127b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:28:28.955149 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-47a8e284-7eb2-4adc-9eb6-a1bd1e9127b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:28:28.955845 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-47a8e284-7eb2-4adc-9eb6-a1bd1e9127b7 admin admin] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:28:28.956282 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-47a8e284-7eb2-4adc-9eb6-a1bd1e9127b7 admin admin] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:28:28.956687 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-47a8e284-7eb2-4adc-9eb6-a1bd1e9127b7 admin admin] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:28:28.976639 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-47a8e284-7eb2-4adc-9eb6-a1bd1e9127b7 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078335 Oct 03 13:28:28.977113 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 3 13:28:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:28:40.507058 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:28:40.508071 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 03 13:28:40.508473 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:28:40.653862 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=4 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:40.654590 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell1:SELECT=4 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:40.655324 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=8 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:28:40.705061 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-fa49c106-8b3f-4e1b-843b-2ba839345b87 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:28:40.708465 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-fa49c106-8b3f-4e1b-843b-2ba839345b87 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:28:40.708953 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-fa49c106-8b3f-4e1b-843b-2ba839345b87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:28:40.709377 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-fa49c106-8b3f-4e1b-843b-2ba839345b87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:28:40.710121 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-fa49c106-8b3f-4e1b-843b-2ba839345b87 admin admin] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:28:40.710567 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-fa49c106-8b3f-4e1b-843b-2ba839345b87 admin admin] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:28:40.710989 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-fa49c106-8b3f-4e1b-843b-2ba839345b87 admin admin] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:28:40.736525 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-fa49c106-8b3f-4e1b-843b-2ba839345b87 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.087906 Oct 03 13:28:40.737081 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 3 13:28:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:28:41.837778 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:28:41.838789 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-edf7cf16-8e57-49b1-bc4f-3613978f4c09 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 03 13:28:41.839191 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Mon Oct 3 13:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:28:42.034822 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-d9fd6795-ddf8-4c2f-b040-a3d4cfa4e870 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:28:42.038260 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d9fd6795-ddf8-4c2f-b040-a3d4cfa4e870 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:28:42.038733 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d9fd6795-ddf8-4c2f-b040-a3d4cfa4e870 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:28:42.039166 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d9fd6795-ddf8-4c2f-b040-a3d4cfa4e870 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:28:42.039884 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d9fd6795-ddf8-4c2f-b040-a3d4cfa4e870 admin admin] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:28:42.040328 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d9fd6795-ddf8-4c2f-b040-a3d4cfa4e870 admin admin] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:28:42.040794 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d9fd6795-ddf8-4c2f-b040-a3d4cfa4e870 admin admin] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:28:42.063667 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-d9fd6795-ddf8-4c2f-b040-a3d4cfa4e870 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.082108 Oct 03 13:28:42.064152 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Mon Oct 3 13:28:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:29:44.342907 dv-cinder-860090-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 03 13:29:44.344105 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: Mon Oct 3 13:29:44 2022 - graceful shutdown triggered... Oct 03 13:29:44.344553 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: Gracefully killing worker 1 (pid: 105450)... Oct 03 13:29:44.345061 dv-cinder-860090-1-iscsi devstack@n-api.service[105451]: Gracefully killing worker 2 (pid: 105451)... Oct 03 13:29:44.473318 dv-cinder-860090-1-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=4 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:29:45.344072 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: worker 1 buried after 1 seconds Oct 03 13:29:45.344269 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: worker 2 buried after 1 seconds Oct 03 13:29:45.344269 dv-cinder-860090-1-iscsi devstack@n-api.service[105449]: goodbye to uWSGI. Oct 03 13:29:45.346074 dv-cinder-860090-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 03 13:29:45.346690 dv-cinder-860090-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 03 13:29:45.350648 dv-cinder-860090-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 03 13:29:45.363988 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 13:29:45 2022] *** Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: nodename: dv-cinder-860090-1-iscsi Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: machine: x86_64 Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: clock source: unix Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: pcre jit disabled Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: detected number of CPU cores: 4 Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: current working directory: / Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: detected binary path: /usr/bin/uwsgi-core Oct 03 13:29:45.366049 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: your processes number limit is 47680 Oct 03 13:29:45.367266 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: your memory page size is 4096 bytes Oct 03 13:29:45.367266 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: detected max file descriptor number: 2048 Oct 03 13:29:45.367266 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: lock engine: pthread robust mutexes Oct 03 13:29:45.367266 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: thunder lock: enabled Oct 03 13:29:45.367266 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 03 13:29:45.367266 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 13:29:45.410387 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: Python main interpreter initialized at 0x55f7f32519c0 Oct 03 13:29:45.410387 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: python threads support enabled Oct 03 13:29:45.410387 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: your server socket listen backlog is limited to 100 connections Oct 03 13:29:45.410387 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: your mercy for graceful operations on workers is 90 seconds Oct 03 13:29:45.410930 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 13:29:45.410930 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: *** Operational MODE: preforking *** Oct 03 13:29:45.411123 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: *** uWSGI is running in multiple interpreter mode *** Oct 03 13:29:45.411123 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: spawned uWSGI master process (pid: 120720) Oct 03 13:29:45.411336 dv-cinder-860090-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 03 13:29:45.411931 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: spawned uWSGI worker 1 (pid: 120742, cores: 1) Oct 03 13:29:45.412472 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: spawned uWSGI worker 2 (pid: 120743, cores: 1) Oct 03 13:29:45.412772 dv-cinder-860090-1-iscsi devstack@n-api.service[120720]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 13:29:46.075553 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 13:29:46.082711 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 03 13:29:47.244504 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:29:47.244504 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: from cryptography.utils import int_from_bytes Oct 03 13:29:47.245138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:29:47.245138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: from cryptography.utils import int_from_bytes Oct 03 13:29:47.273744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:29:47.273744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: from cryptography.utils import int_from_bytes Oct 03 13:29:47.274332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 13:29:47.274332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: from cryptography.utils import int_from_bytes Oct 03 13:29:49.760410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 13:29:49.761045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 13:29:49.761370 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 13:29:49.761595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 13:29:49.761852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 13:29:49.762248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.762578 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.762900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.763221 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.763561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.763974 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.764443 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.764769 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.765144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.765410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.765756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.766260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860090-1-iscsi {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.766587 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.766900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.767212 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.767536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.767842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.768170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.768491 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.768997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.770639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.770950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.771267 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.771638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.771945 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.772258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.772585 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.772901 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.773226 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.773565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.773973 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860090-1-iscsi {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.774297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.774609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.774921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.775353 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.775667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.778436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.778436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.778436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.778436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.778436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.778436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.778436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.778436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.779049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.779049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.779199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.779584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.779823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.780167 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.780362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.780797 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.781133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.781487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.781818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.782070 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.782329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.782640 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.782958 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.783268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.783573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.783877 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.784183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.784489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.784799 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.785098 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.785402 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.785751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.786073 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.786396 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.786704 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.787021 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.787430 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.787679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.787984 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.788327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.788644 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.788955 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.789274 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.789625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.789941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.790293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.790600 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.790925 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.791264 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.791572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.791823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.792128 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.792430 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.792755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.793055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.793361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.793691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.793994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.794297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.794604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.794907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.795826 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.796139 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.796448 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.796941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.797253 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.797599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.797907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.798234 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.798556 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.798861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.799165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.799469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.799772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.800090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.800396 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.800704 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.801027 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.801499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.801678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.802000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.802279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.802585 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.802906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.803207 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.803512 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.803829 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.804132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.804436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.804743 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.805045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.805346 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.805675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.805980 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.806282 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.806581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.806897 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.807217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.807533 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.807832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.808135 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.808454 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.808790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.809484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.809484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.809797 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.810109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.810438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.811335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.811798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.812133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.812459 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.812772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.813085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.813395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.813738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.814058 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.814390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.814708 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.815025 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.815344 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.815653 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.815970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.816298 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.816619 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.816735 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 13:29:49.817133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.817228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 13:29:49.817310 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.817542 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 13:29:49.817646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.817907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.818015 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 13:29:49.818191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 13:29:49.818287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.818543 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.818654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.818857 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.818963 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.819168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.819268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.819477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.819641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.819808 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.819962 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.820115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.820272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.820416 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.820566 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.820718 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.820896 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.821048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.821191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.821344 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.821512 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.821664 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.821865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.822024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.822179 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860090-1-iscsi {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.822333 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.822478 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.822629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.822788 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.822944 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.823096 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.823251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.823397 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.823554 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.823705 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.823850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.823994 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.824155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.824299 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.824454 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.824686 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.824852 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.825025 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.825180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.825339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.825530 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.825692 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.825837 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.825999 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.826152 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.826351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.826514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.826688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.826844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.826991 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.827142 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.827300 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.827454 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.827790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.827957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.828102 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.828266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.828426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.828572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.828723 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860090-1-iscsi {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.828883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.828883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.829170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.829315 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.829485 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.829637 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.829803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.829963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.830118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.830281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.830426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.830577 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.830737 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.830896 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.831041 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.831185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.831329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.831480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.831631 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.831786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.831973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.832141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.832295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.832442 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.832594 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.832749 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.832902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.833047 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.833191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.833334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.833510 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.833669 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.833815 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.833973 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.834128 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.834280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.834438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.834590 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.834760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.834991 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.835149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.835310 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.835465 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.835610 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.835761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.835918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.836063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.836230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.836385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.836544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.836696 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.836850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.836995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.837160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.837305 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.837475 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.837637 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.838479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.838665 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.838814 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.838966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.839113 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.839256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.839408 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.839565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.839729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.839885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.840039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.840184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.840334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.840488 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.840648 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.840801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.840959 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.841117 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.841344 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.841531 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.841693 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.841850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.842092 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.842246 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.842401 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.842555 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.842712 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.842868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.843013 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.843165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.843319 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.843474 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.843632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.843632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.843918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.844062 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.844206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.844361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.844514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.844672 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.844824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.844988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.845223 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.845389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.845589 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.845744 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.845898 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.846050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.846202 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.846361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.846522 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.846668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.846835 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.846988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.847141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.847301 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.847447 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.847600 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.847745 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.847916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.848168 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.848329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.848501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.848740 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.848898 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.849055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.849243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.849396 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.849630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.849786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.849930 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.850082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.850237 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.850393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.850538 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.850691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.850835 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.850979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.851142 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.851295 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.851446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.851598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.851750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.851903 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.852104 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.852257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.852401 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.852552 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.852698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.852851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.853003 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.853159 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.853314 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.853477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.853629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.853790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.853942 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.854095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.854240 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.854393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.854548 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.854853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.855009 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.855167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.855403 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.855553 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.855706 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.855852 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.856005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.856159 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.856313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.856465 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.856609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.856753 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.856898 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.857062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.857208 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.857351 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.858102 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.858418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.858594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.858761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.859012 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.859164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.859318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.859471 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.859627 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.859783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.859988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.860137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.860288 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.860441 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.860600 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.860753 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.860907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.861053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.861198 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.861198 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.861514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.861692 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.861841 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.862004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.862203 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.862366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.862522 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.862676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.862822 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.862966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.863118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.863278 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.863423 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.863575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.863720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.863864 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.864017 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.864172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.864326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.864484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.864636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 13:29:49.864782 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.864932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.865092 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.865238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.865411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.866270 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.866444 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.866593 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.866739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.866882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.867048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.867195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.867347 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.867492 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.867636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.867780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.867940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.868086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.868247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.868247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.868653 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.868814 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.868961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.869236 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.869388 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.869560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.869727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.869957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.870114 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.870268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.870413 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.870579 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.870733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.870893 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.871038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.871191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.871336 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.871489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.871644 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.871803 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.871949 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.872094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.872289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.872460 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.872617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.872787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.872944 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.873090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.873090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.873988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.874153 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.874298 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.874450 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.874603 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.874603 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.874959 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.875131 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.875289 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.875441 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.875586 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.875845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.876011 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.876165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.876312 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.876466 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.876632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.876785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.876936 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.877086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.877086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.877391 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.877391 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.877769 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.877930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.877930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.878216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.878613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.878932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.879098 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.879268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.879546 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.879710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.879891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.880046 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.880205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.880356 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.880507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.880658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.880822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.880974 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.881126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.881276 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.881426 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.881615 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.881794 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.881955 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.882109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.882260 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.882472 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.882637 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.882798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.882950 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883103 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883261 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883465 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883740 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.883912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884097 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884274 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884367 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884556 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884650 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.884914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885097 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885283 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885370 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885515 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885618 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885713 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.885974 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886161 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886344 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886429 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886793 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.886974 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887057 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887232 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887331 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887331 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887497 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887592 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887686 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887783 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887876 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.887962 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888045 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888129 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888220 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888319 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888405 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888488 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888662 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.888910 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.889056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.889329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.889431 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.889746 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.889965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.890104 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.890325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.890423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.890646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.890745 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.890964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.891057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.891267 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.891366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.891572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.891683 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.891876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.892011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.892186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.892329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.892514 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.892650 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.892794 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.892934 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.893090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.893186 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.893397 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.893510 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.893724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.893829 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.894027 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.894121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.894334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.894436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.894633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.894735 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.894935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.895026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.895241 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.895408 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.895557 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.895650 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.895869 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.895961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.896169 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.896275 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.896473 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.896567 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.896774 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.896866 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.897077 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.897171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.897380 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.897516 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.897726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.897821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.898029 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.898122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.898334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.898434 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.898635 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.898735 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.898936 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.899030 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.899236 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.899338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.899561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.899655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.899871 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.899972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.900174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.900267 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.900485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.900589 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.900789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.900883 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.901132 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.901230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.901435 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.901641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.901781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.901881 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.902109 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.902257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.902423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.902584 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.902743 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.902847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.903048 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.903141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.903354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.903468 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.903668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.903761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.903971 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.904073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.904287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.904425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.904646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.904852 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.904957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.905322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.905443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.905589 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.905880 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.906001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.906189 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.906500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.906822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.907007 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.907173 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.907328 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.907481 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.907632 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.907798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.907959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.908120 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.908282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.908442 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.908602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.908764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.908917 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.909080 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.909231 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.909392 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.909663 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.909821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.909972 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.910130 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.910283 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.910482 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.910803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.911137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.911473 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.911850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.911984 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.912190 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.912321 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.912575 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.912713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.912827 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.912954 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.913121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.913234 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.913435 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.913582 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.913780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.913876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.914174 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.914278 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.914494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.914597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.914808 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.914902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.915118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.915219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.915431 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.915524 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.915739 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.915840 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.916049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.916142 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.916362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.916495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.916672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.916789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.916979 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.917107 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.917291 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.917419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.917645 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.917760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.917960 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.918060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.918289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.918382 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.918619 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.918721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.918927 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.919027 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.919234 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.919382 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.919561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.919699 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.919870 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.920618 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.920741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.920916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.921225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.921336 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.921558 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.921743 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.921876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.922101 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.922210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.922421 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.922521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.922733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.922828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.923132 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.923252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.923382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.923476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.923690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.923792 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.924010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.924124 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.924328 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.924422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.924643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.924736 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.924973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.925081 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.925293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.925426 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.925641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.925768 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.925977 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.926081 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.926295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.926406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.926634 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.926762 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.926966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.927062 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.927296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.927390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.927611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.927706 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.927927 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.928022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.928242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.928336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.928550 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.928644 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.928863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.928958 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.929180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.929281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.929509 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.929803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.929933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.930150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.930255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.930463 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.930555 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.930793 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.930955 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.931140 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.931305 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.931467 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.931617 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.931793 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.931938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.932128 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.932281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.932449 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.932597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.932741 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.932879 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.933050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.933227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.933363 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.933507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.933698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.933803 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.934013 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.934117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.934321 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.934414 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.934630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.934723 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.934937 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.935045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.935268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.935371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.935558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.935679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.936472 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.936572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.936789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.937119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.937264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.937417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.937557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.937767 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.937869 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.938085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.938188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.938405 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.938512 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.938721 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.938823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.939027 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.939118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.939354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.939461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.939663 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.939762 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.939966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.940072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.940276 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.940470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.940569 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.940655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.940920 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.941035 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.941263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.941387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.941615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.941711 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.941953 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.942046 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.942261 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.942362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.942573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.942676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.942977 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.943177 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.943282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.943519 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.943619 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.943707 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.943791 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.943887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.944109 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.944227 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.944419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.944520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.944726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.944835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.945038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.945139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.945347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.945439 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.945673 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.945784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.945980 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.946083 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.946283 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.946376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.946588 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.946717 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.946893 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.947001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.947193 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.947288 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.947497 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.947592 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.947801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.947901 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.948108 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.948212 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.948423 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.948526 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.948731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.948831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.949034 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.949134 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.949340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.949444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.949667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.949762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.949987 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.950096 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.950302 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.950421 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.950609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.950715 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.950915 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.951035 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.951226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.951451 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.951615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.951870 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.952186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.952387 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.952491 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.952725 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.952818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.953066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.953203 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.953384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.953527 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.953743 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.953851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.954041 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.954125 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.954358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.954443 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.954672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.954807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.954983 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.955241 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.955353 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.955598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.955709 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.955883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.956097 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.956286 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.956444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.956697 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.956803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.957008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.957338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.957513 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.957731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.957731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.958038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.958038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.958357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.958555 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.958861 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.958961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.959420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.959420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.959791 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.959945 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.960049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.960183 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.960267 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.960351 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.960445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.960654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.961193 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.961339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.961561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.961848 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.962084 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.962270 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.962369 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.962499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.962604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.962694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.962836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.962936 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.963024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.963245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.963245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.963498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.963646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.963646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.963957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964061 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964148 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964402 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964489 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964623 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964738 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964738 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.964998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.965085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.965170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.965272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.965431 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.965580 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.965783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.965893 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.966101 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.966209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.966417 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.966521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.966744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.966848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.967100 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.967216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.967412 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.967722 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.967822 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.968043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.968162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.968459 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.968591 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.968778 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.968908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.969100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.969263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.969416 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.969619 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.969766 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.969947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.970084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.970268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.970402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.970586 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.970720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.970920 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.971042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.971227 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.971329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.971534 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.971655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.971846 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.971962 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.972155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.972277 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.972460 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.972573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.972781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.972895 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.973090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.973221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.973394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.973532 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.973739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.973853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.974049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.974163 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.974393 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.974583 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.974688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.974934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.975140 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.975255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.975462 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.975615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.975783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.975885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.976097 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.976191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.976415 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.976507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.976733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.976827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.977056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.977206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.977411 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.977630 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.977771 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.977915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.978057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.978196 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.978344 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.978496 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.978639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.978785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.978933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.979085 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.979227 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.979385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.979589 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.979736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.979908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.980052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.980194 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.980349 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.980524 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.980670 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.980811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.980966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.981117 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.981277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.981427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.981624 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.981788 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.981885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.982028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.982121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.982331 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.983017 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.983190 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.983468 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.983607 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.983780 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.984072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.984237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.984476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.984577 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.984779 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.984882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.985089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.985181 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.985434 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.985567 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.985766 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.985880 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.986069 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.986163 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.986392 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.986495 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.986696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.986789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.986997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.987100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.987314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.987454 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.987623 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.987769 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.987943 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.988038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.988254 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.988358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.988564 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.988694 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.988898 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.989000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.989208 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.989301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.989558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.989777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.989897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.990116 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.990320 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.990440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.990651 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.990777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.990969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.991112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.991299 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.991427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.991634 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.991730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.991948 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.992057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.992259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.992388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.992575 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.992670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.992886 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.993066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.993200 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.993302 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.993542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.993679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.993851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.993965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.994160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.994293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.994468 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.994570 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.994775 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.994884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.995082 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.995173 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.995387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.995478 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.995695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.995833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.996001 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.996096 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.996308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.996414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.996614 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.996708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.996923 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.997024 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.997257 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.997349 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.997595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.997704 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.997910 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.998013 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.998772 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.998922 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.999138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.999339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.999434 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.999745 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:49.999837 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.000055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.000150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.000364 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.000464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.000677 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.000777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.001008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.001104 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.001326 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.001489 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.001660 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.001766 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.002020 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.002120 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.002363 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.002468 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.002686 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.002793 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.003006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.003100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.003315 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.003700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.003890 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.004040 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.004208 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.004301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.004518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.004622 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.004826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.004929 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.005131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.005231 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.005436 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.005592 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.005771 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.005880 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.006081 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.006179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.006394 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.006490 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.006700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.006794 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.007010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.007112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.007317 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.007456 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.007642 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.007749 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.007953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.008053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.008258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.008350 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.008561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.008663 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.008863 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.008968 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.009170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.009279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.009490 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.009585 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.009799 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.009902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.010100 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.010203 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.010404 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.010552 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.010709 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.010812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.011009 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.011116 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.011317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.011411 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.011617 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.011722 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.011916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.012067 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.012210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.012309 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.012502 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.012602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.012807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.012909 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.013109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.013203 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.013412 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.013535 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.013828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.013988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.014100 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.014496 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.014611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.014703 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.014853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.014999 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.015312 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.015415 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.015632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.015727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.015941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.016075 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.016261 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.016356 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.016569 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.016677 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.016888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.016989 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.017206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.017300 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.017548 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.017662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.017858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.017954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.018180 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.018283 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.018486 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.018592 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.018795 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.018889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.019106 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.019206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.019415 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.019518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.019722 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.019816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.020031 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.020124 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.020358 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.020463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.020682 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.020784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.020989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.021094 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.021318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.021413 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.021659 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.021755 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.021975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.022083 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.022289 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.022399 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.022597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.022692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.022911 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.023087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.023220 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.023302 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.023530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.023639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.023834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.023949 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.024145 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.024265 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.024632 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.024759 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.024759 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.024945 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.025055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.025158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.025363 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.025486 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.025703 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.025800 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.026017 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.026131 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.026343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.026451 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.026655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.026750 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.026959 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.027055 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.027280 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.027381 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.027601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.027814 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.027950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.028125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.028296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.028464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.028608 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.028779 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.028897 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.029137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.029302 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.029536 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.029680 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.029843 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.030038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.030133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 13:29:50.030495 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.030812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.031125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.031444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.031761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.032074 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.032403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.032720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.033030 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.033355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.033696 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.034251 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.034598 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.034924 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.035254 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.035584 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.035906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.036218 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.036547 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.036858 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.037166 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.037508 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.037826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.038137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.038444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.038756 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.039067 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.039377 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.039697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.040002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.040331 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.040640 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.040950 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.041257 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.041597 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.041907 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.042214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.042522 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.042830 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.043145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.043449 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.043854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.044160 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.044474 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.044889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.045718 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.046290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.046688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.047001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.047313 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.047636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.047960 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.048326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.048625 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.048941 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.049378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.049653 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.050208 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.050547 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.050873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.051213 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.051550 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.051862 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.052175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.052488 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.052812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.053123 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.053437 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.053773 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.054085 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.054399 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.054709 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.055023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.055331 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.055641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.055951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.056260 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.056571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.056882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.057191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.057534 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.057882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.058208 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.058526 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.058844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.059164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.059476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.059786 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.060104 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.060415 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.061335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.061997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.062312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.062630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.063064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.063383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.063710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.064036 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.064352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.064679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.065007 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.065323 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.065673 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.065992 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.066327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.066670 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.067002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.067330 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.067639 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.067948 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.068256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.068573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.068895 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.069208 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.069536 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.069845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.070162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.070472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.070783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.071090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.071399 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.071710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.072014 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.072321 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.072626 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.072932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.073238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.073636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.073951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.074257 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.074565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.074872 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.075211 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.075480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.075814 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.076150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.076546 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.077242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.077542 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.077878 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.078200 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.078526 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.078851 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.079173 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.079486 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.079826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.080146 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.080461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.080781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.081096 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.081405 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.081745 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.082082 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.082416 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.082727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.083059 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.083383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.083706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.084026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.084341 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.084673 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.084989 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.085304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.085643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.085959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.086272 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.086589 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.086902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.087215 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.087535 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.087853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.088184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.088511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.088824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.089149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.089495 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.089851 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.090171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.090517 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.090848 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.091164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.091478 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.091787 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 13:29:50.092601 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 13:29:50.092848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO dbcounter [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Registered counter for database nova_api Oct 03 13:29:50.113664 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_db.sqlalchemy.engines [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:29:50.120151 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writer thread running {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:29:50.157238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO dbcounter [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Registered counter for database nova_api Oct 03 13:29:50.178215 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.context [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4538db60-5857-474d-9312-77364756bb5d(cell1) {{(pid=120742) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 13:29:50.178459 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_db.sqlalchemy.engines [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:29:50.182419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:29:50.182894 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:29:50.184439 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:29:50.184767 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writer thread running {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:29:50.185189 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:29:50.185998 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:29:50.188222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:29:50.190251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO dbcounter [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Registered counter for database nova_cell0 Oct 03 13:29:50.194446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO dbcounter [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Registered counter for database nova_cell1 Oct 03 13:29:50.202090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_db.sqlalchemy.engines [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:29:50.204355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_db.sqlalchemy.engines [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:29:50.208690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writer thread running {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:29:50.243235 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.context [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4538db60-5857-474d-9312-77364756bb5d(cell1) {{(pid=120743) load_cells /opt/stack/nova/nova/context.py:464}} Oct 03 13:29:50.247301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:29:50.247774 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:29:50.250006 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:29:50.250760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:29:50.251211 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:29:50.253215 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:29:50.255625 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO dbcounter [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Registered counter for database nova_cell0 Oct 03 13:29:50.259760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO dbcounter [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Registered counter for database nova_cell1 Oct 03 13:29:50.271499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_db.sqlalchemy.engines [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:29:50.272689 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_db.sqlalchemy.engines [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:29:50.281568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writer thread running {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:29:50.281915 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writer thread running {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:29:50.355191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writer thread running {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:29:50.365517 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO dbcounter [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Registered counter for database nova_cell0 Oct 03 13:29:50.372284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_db.sqlalchemy.engines [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:29:50.377310 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writer thread running {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:29:50.435458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO dbcounter [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Registered counter for database nova_cell0 Oct 03 13:29:50.443643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_db.sqlalchemy.engines [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 13:29:50.448168 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writer thread running {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 13:29:50.697520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: WARNING keystonemiddleware.auth_token [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 13:29:50.705624 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: WARNING keystonemiddleware.auth_token [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 13:29:50.775418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: WARNING keystonemiddleware.auth_token [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 13:29:50.783437 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: WARNING keystonemiddleware.auth_token [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 13:29:51.054420 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: WARNING keystonemiddleware.auth_token [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 13:29:51.060667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: WARNING keystonemiddleware.auth_token [None req-1aae0cf2-632b-4891-8924-e254fc662a18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 13:29:51.066575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7f32519c0 pid: 120742 (default app) Oct 03 13:29:51.133236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: WARNING keystonemiddleware.auth_token [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 03 13:29:51.139750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: WARNING keystonemiddleware.auth_token [None req-73896d7f-a50d-4a6c-aa8d-e52c4f481918 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 03 13:29:51.145086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f7f32519c0 pid: 120743 (default app) Oct 03 13:30:27.438104 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=3 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:27.439534 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=3 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:27.440772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=3 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:27.442342 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=3 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:28.441206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:28.442172 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:28.443074 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:28.445366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:30:28.515322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-373aa673-ffe3-4b34-b2b4-5bba4c2679d6 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Action: 'create', calling method: .version_select at 0x7f7c22996550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-899872687", "metadata": {"Type": "work"}}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-373aa673-ffe3-4b34-b2b4-5bba4c2679d6 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Request method failure captured: Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 121 Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuPzo5EpwJKVPXkMBvHrBGCHm3NWo5LKBPg0V2zkvhdXtXmWce-1lW6tPSvcriSCIdqZJ5jN28LU3gNv0IvFI9EaeEfTNQVtQ8WrYjLHg3t8zTkudAcJkgVIepYOfDxAb0c5uEROzpj4O-Zc9-uxrtaZXpAS8rInzIZIvwzu5peui94 Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:30:28.521728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 82edf464a87948c9a806b5986b7e014b Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-899872687", "metadata": {"Type": "work"}}} Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: Oct 03 13:30:28.523436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-899872687', 'metadata': {'Type': 'work'}}}} Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise error Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi '#$%' Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:28.524440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 13:30:28.526886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 13:30:28.528082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 03 13:30:28.528082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.528082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-373aa673-ffe3-4b34-b2b4-5bba4c2679d6 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:28.528082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-373aa673-ffe3-4b34-b2b4-5bba4c2679d6 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.104387 Oct 03 13:30:28.528082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Oct 3 13:30:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:30:28.536886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-da0f6a8e-9755-402e-86e5-63db1c63a3b8 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Action: 'create', calling method: .version_select at 0x7f7c22996e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1868575195", "metadata": {"Type": "work"}}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-da0f6a8e-9755-402e-86e5-63db1c63a3b8 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Request method failure captured: Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 120 Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuPzo5EpwJKVPXkMBvHrBGCHm3NWo5LKBPg0V2zkvhdXtXmWce-1lW6tPSvcriSCIdqZJ5jN28LU3gNv0IvFI9EaeEfTNQVtQ8WrYjLHg3t8zTkudAcJkgVIepYOfDxAb0c5uEROzpj4O-Zc9-uxrtaZXpAS8rInzIZIvwzu5peui94 Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:30:28.540469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 82edf464a87948c9a806b5986b7e014b Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1868575195", "metadata": {"Type": "work"}}} Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: Oct 03 13:30:28.541855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1868575195', 'metadata': {'Type': 'work'}}}} Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise error Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi '0' Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:28.542718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 13:30:28.544230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 13:30:28.550214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 03 13:30:28.550214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.550214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-da0f6a8e-9755-402e-86e5-63db1c63a3b8 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:28.550214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-da0f6a8e-9755-402e-86e5-63db1c63a3b8 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008990 Oct 03 13:30:28.550214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 2/2] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Oct 3 13:30:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:30:28.556909 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cbfe5d90-eabe-48b7-ade0-917cf0448051 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Action: 'create', calling method: .version_select at 0x7f7c22852280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2068486530", "metadata": {"Type": "work"}}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cbfe5d90-eabe-48b7-ade0-917cf0448051 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Request method failure captured: Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 119 Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuPzo5EpwJKVPXkMBvHrBGCHm3NWo5LKBPg0V2zkvhdXtXmWce-1lW6tPSvcriSCIdqZJ5jN28LU3gNv0IvFI9EaeEfTNQVtQ8WrYjLHg3t8zTkudAcJkgVIepYOfDxAb0c5uEROzpj4O-Zc9-uxrtaZXpAS8rInzIZIvwzu5peui94 Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:30:28.559162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 82edf464a87948c9a806b5986b7e014b Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2068486530", "metadata": {"Type": "work"}}} Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: Oct 03 13:30:28.560679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2068486530', 'metadata': {'Type': 'work'}}}} Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise error Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi '' Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:28.561604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 03 13:30:28.563942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 03 13:30:28.565241 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 03 13:30:28.565241 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:28.565241 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cbfe5d90-eabe-48b7-ade0-917cf0448051 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:28.565241 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cbfe5d90-eabe-48b7-ade0-917cf0448051 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009686 Oct 03 13:30:28.565241 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 3/3] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Oct 3 13:30:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:30:28.576092 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e0bc6527-4ced-4892-9c5e-8444900a6106 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Calling method '.version_select at 0x7f7c22852ca0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:29.604797 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-e0bc6527-4ced-4892-9c5e-8444900a6106 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] HTTP exception thrown: Volume tempest-invalid-652574648 could not be found. Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e0bc6527-4ced-4892-9c5e-8444900a6106 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Request method failure captured: Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-652574648 HTTP/1.1 Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuPzo5EpwJKVPXkMBvHrBGCHm3NWo5LKBPg0V2zkvhdXtXmWce-1lW6tPSvcriSCIdqZJ5jN28LU3gNv0IvFI9EaeEfTNQVtQ8WrYjLHg3t8zTkudAcJkgVIepYOfDxAb0c5uEROzpj4O-Zc9-uxrtaZXpAS8rInzIZIvwzu5peui94 Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:30:29.613323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 82edf464a87948c9a806b5986b7e014b Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Volume tempest-invalid-652574648 could not be found. Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': 'tempest-invalid-652574648'} Oct 03 13:30:29.614599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-652574648 could not be found. (HTTP 404) (Request-ID: req-c0e3c047-ba8b-4ac6-9f16-5e99fa0806d1) Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:29.615343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 13:30:29.616621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-652574648 could not be found. Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:30:29.618089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-652574648 could not be found. Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-652574648 could not be found. Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e0bc6527-4ced-4892-9c5e-8444900a6106 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Returning 404 to user: Volume tempest-invalid-652574648 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e0bc6527-4ced-4892-9c5e-8444900a6106 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-652574648" status: 404 len: 98 microversion: 2.1 time: 1.040233 Oct 03 13:30:29.619657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 4/4] 10.222.0.58 () {58 vars in 1215 bytes} [Mon Oct 3 13:30:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-652574648 => generated 98 bytes in 1041 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 03 13:30:29.812811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a7e63d8e-4516-4266-b10a-4b24d91a6247 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Action: 'create', calling method: .version_select at 0x7f7c229974c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1743585134", "metadata": {"Type": "work"}}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:29.890390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e8288df1-92fe-49e8-84ca-87caa6a9f0c3 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Action: 'create', calling method: .version_select at 0x7f7c22852670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1657580634"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:31.240544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e8288df1-92fe-49e8-84ca-87caa6a9f0c3 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.625101 Oct 03 13:30:31.253988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 5/5] 10.222.0.58 () {60 vars in 1155 bytes} [Mon Oct 3 13:30:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1629 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 13:30:31.264525 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-492d360b-2776-4a7b-8030-20cc7aa33d49 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007847 Oct 03 13:30:31.279923 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 6/6] 10.222.0.58 () {58 vars in 1140 bytes} [Mon Oct 3 13:30:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 13:30:31.309300 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-624ddf8e-1a49-4170-b865-669062099aba tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c22782af0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:31.515099 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a7e63d8e-4516-4266-b10a-4b24d91a6247 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.079653 Oct 03 13:30:31.519242 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-624ddf8e-1a49-4170-b865-669062099aba tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4" status: 200 len: 345 microversion: 2.1 time: 0.230412 Oct 03 13:30:31.527129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 1/7] 10.222.0.58 () {60 vars in 1156 bytes} [Mon Oct 3 13:30:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3093 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 03 13:30:31.528114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 7/8] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:31 2022] GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:31.536868 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7b7ccc95-1bc8-4e52-a0ca-1c13028a013f tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c227861f0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:31.543634 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e53895a0-2149-4da3-a004-25f25a7cc319 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013829 Oct 03 13:30:31.545838 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 2/9] 10.222.0.58 () {58 vars in 1137 bytes} [Mon Oct 3 13:30:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 03 13:30:31.560708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-28d2b16e-cb02-49cc-9dea-bd02a2625883 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Calling method '.version_select at 0x7f7c228695e0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:31.623758 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7b7ccc95-1bc8-4e52-a0ca-1c13028a013f tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/70c672f7-93fe-419b-aeb2-42152b811ef0" status: 200 len: 350 microversion: 2.1 time: 0.094243 Oct 03 13:30:31.624369 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 8/10] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:31 2022] GET /compute/v2.1/os-volumes/70c672f7-93fe-419b-aeb2-42152b811ef0 => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:31.632273 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eb13b4eb-c027-4de6-bc4c-37a69a1d22a4 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Calling method '.version_select at 0x7f7c22786940>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:31.696518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-28d2b16e-cb02-49cc-9dea-bd02a2625883 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2" status: 200 len: 353 microversion: 2.1 time: 0.147443 Oct 03 13:30:31.703872 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 3/11] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:31 2022] GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-eb13b4eb-c027-4de6-bc4c-37a69a1d22a4 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] HTTP exception thrown: Volume 5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd could not be found. Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eb13b4eb-c027-4de6-bc4c-37a69a1d22a4 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Request method failure captured: Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/os-volumes/5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd HTTP/1.1 Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuPzo5EpwJKVPXkMBvHrBGCHm3NWo5LKBPg0V2zkvhdXtXmWce-1lW6tPSvcriSCIdqZJ5jN28LU3gNv0IvFI9EaeEfTNQVtQ8WrYjLHg3t8zTkudAcJkgVIepYOfDxAb0c5uEROzpj4O-Zc9-uxrtaZXpAS8rInzIZIvwzu5peui94 Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:30:31.829813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 82edf464a87948c9a806b5986b7e014b Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Volume 5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd could not be found. Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd'} Oct 03 13:30:31.833671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd could not be found. (HTTP 404) (Request-ID: req-c8b42cf1-fa61-4db9-ad2a-84638c798de7) Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:31.885841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 13:30:31.893479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd could not be found. Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 13:30:31.897022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd could not be found. Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd could not be found. Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eb13b4eb-c027-4de6-bc4c-37a69a1d22a4 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Returning 404 to user: Volume 5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-eb13b4eb-c027-4de6-bc4c-37a69a1d22a4 tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd" status: 404 len: 109 microversion: 2.1 time: 0.195241 Oct 03 13:30:31.898126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 9/12] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:30:31 2022] DELETE /compute/v2.1/os-volumes/5ddc1e25-291a-4b2c-a20b-9ba0dea9aacd => generated 109 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:30:31.898957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-493ba298-9ac5-43ae-bda0-0e9620f998de tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Calling method '.version_select at 0x7f7c22869ca0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:31.999071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-493ba298-9ac5-43ae-bda0-0e9620f998de tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] HTTP exception thrown: Volume da06d78d-229e-4370-b0cc-acff416001e3 could not be found. Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-493ba298-9ac5-43ae-bda0-0e9620f998de tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Request method failure captured: Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/os-volumes/da06d78d-229e-4370-b0cc-acff416001e3 HTTP/1.1 Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuPzo5EpwJKVPXkMBvHrBGCHm3NWo5LKBPg0V2zkvhdXtXmWce-1lW6tPSvcriSCIdqZJ5jN28LU3gNv0IvFI9EaeEfTNQVtQ8WrYjLHg3t8zTkudAcJkgVIepYOfDxAb0c5uEROzpj4O-Zc9-uxrtaZXpAS8rInzIZIvwzu5peui94 Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:30:32.013150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3d84507eb30f4a7fabd41f8962a98e06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 3d84507eb30f4a7fabd41f8962a98e06 Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesNegativeTest-1880953359 Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 82edf464a87948c9a806b5986b7e014b Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesNegativeTest-1880953359-project Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Volume da06d78d-229e-4370-b0cc-acff416001e3 could not be found. Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'da06d78d-229e-4370-b0cc-acff416001e3'} Oct 03 13:30:32.014783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da06d78d-229e-4370-b0cc-acff416001e3 could not be found. (HTTP 404) (Request-ID: req-0b86cba9-0e26-48b5-96f0-ac61816cb7e3) Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:32.016071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:32.017016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da06d78d-229e-4370-b0cc-acff416001e3 could not be found. Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 13:30:32.017847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da06d78d-229e-4370-b0cc-acff416001e3 could not be found. Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da06d78d-229e-4370-b0cc-acff416001e3 could not be found. Oct 03 13:30:32.018662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:32.024559 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-493ba298-9ac5-43ae-bda0-0e9620f998de tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] Returning 404 to user: Volume da06d78d-229e-4370-b0cc-acff416001e3 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:32.028039 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-493ba298-9ac5-43ae-bda0-0e9620f998de tempest-VolumesNegativeTest-1880953359 tempest-VolumesNegativeTest-1880953359-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/da06d78d-229e-4370-b0cc-acff416001e3" status: 404 len: 109 microversion: 2.1 time: 0.198433 Oct 03 13:30:32.032356 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 4/13] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:31 2022] GET /compute/v2.1/os-volumes/da06d78d-229e-4370-b0cc-acff416001e3 => generated 109 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:30:32.536021 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9c850383-fbb4-4f30-aba9-0442c296835c tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c22782700>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:32.711700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9c850383-fbb4-4f30-aba9-0442c296835c tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4" status: 200 len: 346 microversion: 2.1 time: 0.180925 Oct 03 13:30:32.712380 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 10/14] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:32 2022] GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 => generated 346 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:32.717347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8acad9a5-3024-44f2-8818-72bba5c50fd1 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Calling method '.version_select at 0x7f7c22804b80>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:32.726957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-96be15fc-83f3-4e46-a816-a27b6e355ac2 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Action: 'create', calling method: .version_select at 0x7f7c22786af0>, body: {"snapshot": {"volume_id": "3749f326-1549-45f4-b1fe-6f439d1aa0c4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-588078571"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:32.975757 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8acad9a5-3024-44f2-8818-72bba5c50fd1 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2" status: 200 len: 354 microversion: 2.1 time: 0.267433 Oct 03 13:30:32.977542 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 5/15] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:32 2022] GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 => generated 354 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:32.998918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-105b53b2-4a60-41ad-8107-0b4e9609a677 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Calling method '.version_select at 0x7f7c227ed280>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:33.183642 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-105b53b2-4a60-41ad-8107-0b4e9609a677 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2" status: 200 len: 354 microversion: 2.1 time: 0.195692 Oct 03 13:30:33.184235 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 6/16] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:32 2022] GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:33.208537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5918c48d-05a1-4a66-8cff-b287e8eab67b tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Calling method '.version_select at 0x7f7c22804670>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:33.365892 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5918c48d-05a1-4a66-8cff-b287e8eab67b tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2" status: 202 len: 0 microversion: 2.1 time: 0.162274 Oct 03 13:30:33.366739 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 7/17] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:30:33 2022] DELETE /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 13:30:33.375232 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cd9ea08b-07d7-4500-9927-4bf51b67ca57 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Calling method '.version_select at 0x7f7c22804af0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:33.495169 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cd9ea08b-07d7-4500-9927-4bf51b67ca57 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2" status: 200 len: 353 microversion: 2.1 time: 0.124150 Oct 03 13:30:33.496431 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 8/18] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:33 2022] GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:33.504356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-96be15fc-83f3-4e46-a816-a27b6e355ac2 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.782202 Oct 03 13:30:33.505573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 11/19] 10.222.0.58 () {60 vars in 1162 bytes} [Mon Oct 3 13:30:32 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:33.520672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0e6a1a7f-79bc-475c-b35f-38854b64dce0 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c227ed3a0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:33.662295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0e6a1a7f-79bc-475c-b35f-38854b64dce0 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 200 len: 286 microversion: 2.1 time: 0.146171 Oct 03 13:30:33.669996 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 9/20] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 3 13:30:33 2022] GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:33.680442 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6269f270-3476-489c-9dbc-dee84ffb37c2 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c227864c0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:33.794465 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6269f270-3476-489c-9dbc-dee84ffb37c2 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.120632 Oct 03 13:30:33.795595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 12/21] 10.222.0.58 () {58 vars in 1140 bytes} [Mon Oct 3 13:30:33 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:30:33.811050 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ab14f6fe-bd63-4e28-9790-847d6eac459b tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c22804940>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:33.894039 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ab14f6fe-bd63-4e28-9790-847d6eac459b tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 200 len: 286 microversion: 2.1 time: 0.088213 Oct 03 13:30:33.897589 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4c0bd31b-9724-489e-9903-256acb40672c tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c22782700>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:33.900936 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 10/22] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 3 13:30:33 2022] GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:34.054480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4c0bd31b-9724-489e-9903-256acb40672c tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/98f0e884-42b8-4c41-85f2-c261fb8fbee9" status: 200 len: 350 microversion: 2.1 time: 0.160561 Oct 03 13:30:34.064276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 13/23] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:33 2022] GET /compute/v2.1/os-volumes/98f0e884-42b8-4c41-85f2-c261fb8fbee9 => generated 350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:34.517288 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e41cd2ec-abd8-407b-af3b-9ede6af186d6 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Calling method '.version_select at 0x7f7c22804700>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:34.590335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-e41cd2ec-abd8-407b-af3b-9ede6af186d6 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] HTTP exception thrown: Volume c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 could not be found. Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e41cd2ec-abd8-407b-af3b-9ede6af186d6 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Request method failure captured: Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 HTTP/1.1 Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuP0UrkA0-hsr7HIdGi2JQk0jVUAM0MTfjHwmi4AC69onIhNbGWkAQk4egnVdG73lx9mlo_9QPUGwCMVXVWoRxY69g9SJQvNNGxUC_B-4YTmwCG4b5495n0lyZNg_IdM6jLx2TBpSEd_pjLPT7x8SWtc8wII4iADI3q-3Z2_kDB5lpY Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 5243c0442fc04fe7b74708c0facdc3ba Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesGetTestJSON-351067471 Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:30:34.596080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5243c0442fc04fe7b74708c0facdc3ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5243c0442fc04fe7b74708c0facdc3ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5243c0442fc04fe7b74708c0facdc3ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5243c0442fc04fe7b74708c0facdc3ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesGetTestJSON-351067471 Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 5243c0442fc04fe7b74708c0facdc3ba Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesGetTestJSON-351067471 Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesGetTestJSON-351067471-project Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 96232e94467b4130b98baed628bae061 Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesGetTestJSON-351067471-project Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Volume c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 could not be found. Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'c55c2ca7-5228-4a8e-a28f-f2787dcda9e2'} Oct 03 13:30:34.597980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 could not be found. (HTTP 404) (Request-ID: req-ef1ad317-b145-4de2-aa21-bd44fb53f80b) Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:34.598959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:34.600279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 could not be found. Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 13:30:34.608212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 could not be found. Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 could not be found. Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e41cd2ec-abd8-407b-af3b-9ede6af186d6 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] Returning 404 to user: Volume c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e41cd2ec-abd8-407b-af3b-9ede6af186d6 tempest-VolumesGetTestJSON-351067471 tempest-VolumesGetTestJSON-351067471-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2" status: 404 len: 109 microversion: 2.1 time: 0.091163 Oct 03 13:30:34.610379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 11/24] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:34 2022] GET /compute/v2.1/os-volumes/c55c2ca7-5228-4a8e-a28f-f2787dcda9e2 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:30:34.909863 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a7a8debb-01ac-48de-b3fc-5a03fee139db tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c22796160>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:35.035925 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a7a8debb-01ac-48de-b3fc-5a03fee139db tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 200 len: 286 microversion: 2.1 time: 0.130929 Oct 03 13:30:35.036509 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 14/25] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 3 13:30:34 2022] GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:30:36.052224 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ce740bac-5483-4c61-a323-a7e261ada404 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c231c0af0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:36.161064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ce740bac-5483-4c61-a323-a7e261ada404 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 200 len: 286 microversion: 2.1 time: 0.115659 Oct 03 13:30:36.162665 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 12/26] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 3 13:30:36 2022] GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:37.175977 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c31c7730-c3ba-4eb6-845f-52e785354896 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c22782f70>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:37.362979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c31c7730-c3ba-4eb6-845f-52e785354896 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 200 len: 286 microversion: 2.1 time: 0.193159 Oct 03 13:30:37.363629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 15/27] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 3 13:30:37 2022] GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:38.378543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-88d6ea8b-e1d3-4417-909a-357709a87bda tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c228049d0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:38.467821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-88d6ea8b-e1d3-4417-909a-357709a87bda tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 200 len: 287 microversion: 2.1 time: 0.094369 Oct 03 13:30:38.477785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 13/28] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 3 13:30:38 2022] GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:38.483724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e7bee7a9-aacd-45cc-ab27-a8e8d21af487 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c228524c0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:38.569922 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4458ac55-448a-4764-95a8-21996c15f7c0 tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c227ed1f0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:38.663225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e7bee7a9-aacd-45cc-ab27-a8e8d21af487 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 202 len: 0 microversion: 2.1 time: 0.184918 Oct 03 13:30:38.663860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 16/29] 10.222.0.58 () {58 vars in 1254 bytes} [Mon Oct 3 13:30:38 2022] DELETE /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 13:30:38.676529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-73a429fc-ec1d-4b15-ad36-2d85faad7952 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c227860d0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:38.744705 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-73a429fc-ec1d-4b15-ad36-2d85faad7952 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 200 len: 286 microversion: 2.1 time: 0.076076 Oct 03 13:30:38.745185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4458ac55-448a-4764-95a8-21996c15f7c0 tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3837848e-c94f-43a4-b4da-c59938f645fe" status: 200 len: 350 microversion: 2.1 time: 0.186180 Oct 03 13:30:38.746389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 17/30] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 3 13:30:38 2022] GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:30:38.759845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 14/31] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:38 2022] GET /compute/v2.1/os-volumes/3837848e-c94f-43a4-b4da-c59938f645fe => generated 350 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:38.772386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-142ed4ca-583c-4fce-8166-28ffc8d4690a tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c22786700>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:39.050408 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-142ed4ca-583c-4fce-8166-28ffc8d4690a tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.285163 Oct 03 13:30:39.050985 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 18/32] 10.222.0.58 () {58 vars in 1134 bytes} [Mon Oct 3 13:30:38 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:39.068409 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6943eec4-67e8-44e9-bcb7-de6f4a7f3d2c tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c227edaf0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:39.411207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6943eec4-67e8-44e9-bcb7-de6f4a7f3d2c tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.347237 Oct 03 13:30:39.412090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 15/33] 10.222.0.58 () {58 vars in 1149 bytes} [Mon Oct 3 13:30:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:39.430399 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-33492e80-be8d-4497-901a-e4db7bed82a9 tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c22786c10>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:39.750999 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-33492e80-be8d-4497-901a-e4db7bed82a9 tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.326017 Oct 03 13:30:39.760443 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 19/34] 10.222.0.58 () {58 vars in 1134 bytes} [Mon Oct 3 13:30:39 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:39.767396 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-03678dbe-4a2d-4912-b41b-ea0892a9110c tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c227ed9d0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:39.776369 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ed3413d2-0c19-47d4-a8e3-a94f115f6495 tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c22782700>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:39.868591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-03678dbe-4a2d-4912-b41b-ea0892a9110c tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] HTTP exception thrown: Snapshot c84835de-9243-43d4-b5da-908b0a3f4dcf could not be found. Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-03678dbe-4a2d-4912-b41b-ea0892a9110c tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Request method failure captured: Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf HTTP/1.1 Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuP013k_ZCJKwuo8LtLj6Mdt7BT2jRkesvobAvqL8hicPnOLZL7OLdQoEIiBYAIjV73Qrl2Gfuk2dhEXpFDC3bYUEwq0PmE6FrXqcEK3i3phn0FJMFgDqDHC9qaYbGsMhhhC5-XM7o1L5wFLoOpwrMn0tQrz9a-D1nLKu2WrieqCpwU Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 277f039d5372403cae3f766dfd01c81c Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:30:39.871337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277f039d5372403cae3f766dfd01c81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 277f039d5372403cae3f766dfd01c81c Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesSnapshotsTestJSON-1263826696-project Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: ddbe4e9452c241bfbeddbdb5e51a865b Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1263826696-project Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Snapshot c84835de-9243-43d4-b5da-908b0a3f4dcf could not be found. Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'c84835de-9243-43d4-b5da-908b0a3f4dcf'} Oct 03 13:30:39.872502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c84835de-9243-43d4-b5da-908b0a3f4dcf could not be found. (HTTP 404) (Request-ID: req-9d629262-3067-4323-a6c9-b63a72ee4e72) Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:39.873127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:39.875319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c84835de-9243-43d4-b5da-908b0a3f4dcf could not be found. Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 03 13:30:39.876205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c84835de-9243-43d4-b5da-908b0a3f4dcf could not be found. Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c84835de-9243-43d4-b5da-908b0a3f4dcf could not be found. Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-03678dbe-4a2d-4912-b41b-ea0892a9110c tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Returning 404 to user: Snapshot c84835de-9243-43d4-b5da-908b0a3f4dcf could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:39.877126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-03678dbe-4a2d-4912-b41b-ea0892a9110c tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf" status: 404 len: 111 microversion: 2.1 time: 0.116526 Oct 03 13:30:39.881734 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 16/35] 10.222.0.58 () {58 vars in 1251 bytes} [Mon Oct 3 13:30:39 2022] GET /compute/v2.1/os-snapshots/c84835de-9243-43d4-b5da-908b0a3f4dcf => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:30:39.883307 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b2c63bdb-a224-4102-a674-7acf8b51b377 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c22804ca0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:40.119529 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b2c63bdb-a224-4102-a674-7acf8b51b377 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4" status: 202 len: 0 microversion: 2.1 time: 0.240157 Oct 03 13:30:40.120107 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 17/36] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:30:39 2022] DELETE /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:30:40.132077 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cc2cea56-94e3-4492-b15c-5105603403cc tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c227ed9d0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:40.138518 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ed3413d2-0c19-47d4-a8e3-a94f115f6495 tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.374448 Oct 03 13:30:40.139178 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 20/37] 10.222.0.58 () {58 vars in 1167 bytes} [Mon Oct 3 13:30:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:40.157471 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-aab39da1-8109-48c9-b637-6d8583dfdc5f tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c22796ee0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:40.361549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cc2cea56-94e3-4492-b15c-5105603403cc tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4" status: 200 len: 345 microversion: 2.1 time: 0.236645 Oct 03 13:30:40.362340 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 18/38] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:40 2022] GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 => generated 345 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:30:40.523937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-aab39da1-8109-48c9-b637-6d8583dfdc5f tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.373592 Oct 03 13:30:40.525229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 21/39] 10.222.0.58 () {58 vars in 1170 bytes} [Mon Oct 3 13:30:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:40.548978 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-75f2f382-79b2-43b3-914f-b5009721e8ca tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c227eddc0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:40.944943 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-75f2f382-79b2-43b3-914f-b5009721e8ca tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.405705 Oct 03 13:30:40.946393 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 19/40] 10.222.0.58 () {58 vars in 1155 bytes} [Mon Oct 3 13:30:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:40.962665 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-392a28cd-aa88-4426-9b6f-ff8aad10fcef tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c22782d30>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:41.316446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-392a28cd-aa88-4426-9b6f-ff8aad10fcef tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.360268 Oct 03 13:30:41.317131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 22/41] 10.222.0.58 () {58 vars in 1188 bytes} [Mon Oct 3 13:30:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:41.336817 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e402e75a-f742-4c52-a7b8-b53ad71ae200 tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] Calling method '.version_select at 0x7f7c227f3790>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:41.385096 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-48844104-fca1-4862-9cc6-7e57adefbcb0 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c22786e50>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:41.479337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-48844104-fca1-4862-9cc6-7e57adefbcb0 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] HTTP exception thrown: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-48844104-fca1-4862-9cc6-7e57adefbcb0 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Request method failure captured: Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 HTTP/1.1 Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuP013k_ZCJKwuo8LtLj6Mdt7BT2jRkesvobAvqL8hicPnOLZL7OLdQoEIiBYAIjV73Qrl2Gfuk2dhEXpFDC3bYUEwq0PmE6FrXqcEK3i3phn0FJMFgDqDHC9qaYbGsMhhhC5-XM7o1L5wFLoOpwrMn0tQrz9a-D1nLKu2WrieqCpwU Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 277f039d5372403cae3f766dfd01c81c Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:30:41.481801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277f039d5372403cae3f766dfd01c81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 277f039d5372403cae3f766dfd01c81c Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesSnapshotsTestJSON-1263826696-project Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: ddbe4e9452c241bfbeddbdb5e51a865b Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1263826696-project Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '3749f326-1549-45f4-b1fe-6f439d1aa0c4'} Oct 03 13:30:41.483114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. (HTTP 404) (Request-ID: req-f57d3cae-45da-4c8b-a2ac-f240f8c772df) Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.484165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:41.485834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 13:30:41.487024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.488006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.491023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-48844104-fca1-4862-9cc6-7e57adefbcb0 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Returning 404 to user: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:41.491023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-48844104-fca1-4862-9cc6-7e57adefbcb0 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4" status: 404 len: 109 microversion: 2.1 time: 0.116667 Oct 03 13:30:41.491023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 23/42] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:41 2022] GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:30:41.508848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d7666a00-d1f2-429b-bd78-e60f87af4276 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c227869d0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:41.636837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-d7666a00-d1f2-429b-bd78-e60f87af4276 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] HTTP exception thrown: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d7666a00-d1f2-429b-bd78-e60f87af4276 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Request method failure captured: Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 HTTP/1.1 Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuP013k_ZCJKwuo8LtLj6Mdt7BT2jRkesvobAvqL8hicPnOLZL7OLdQoEIiBYAIjV73Qrl2Gfuk2dhEXpFDC3bYUEwq0PmE6FrXqcEK3i3phn0FJMFgDqDHC9qaYbGsMhhhC5-XM7o1L5wFLoOpwrMn0tQrz9a-D1nLKu2WrieqCpwU Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 277f039d5372403cae3f766dfd01c81c Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:30:41.638724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277f039d5372403cae3f766dfd01c81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 277f039d5372403cae3f766dfd01c81c Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesSnapshotsTestJSON-1263826696-project Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: ddbe4e9452c241bfbeddbdb5e51a865b Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1263826696-project Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '3749f326-1549-45f4-b1fe-6f439d1aa0c4'} Oct 03 13:30:41.640248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. (HTTP 404) (Request-ID: req-2acd35dc-9bcb-412f-b76d-abd0093b8fb5) Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.641026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 03 13:30:41.641935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 03 13:30:41.642831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.643738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.647472 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d7666a00-d1f2-429b-bd78-e60f87af4276 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Returning 404 to user: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:41.648515 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d7666a00-d1f2-429b-bd78-e60f87af4276 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4" status: 404 len: 109 microversion: 2.1 time: 0.144307 Oct 03 13:30:41.649667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 24/43] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:30:41 2022] DELETE /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:30:41.659505 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-14d82950-a78d-401f-be44-2909b75688b1 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Calling method '.version_select at 0x7f7c227d6ca0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:41.763667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-14d82950-a78d-401f-be44-2909b75688b1 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] HTTP exception thrown: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-14d82950-a78d-401f-be44-2909b75688b1 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Request method failure captured: Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 HTTP/1.1 Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuP013k_ZCJKwuo8LtLj6Mdt7BT2jRkesvobAvqL8hicPnOLZL7OLdQoEIiBYAIjV73Qrl2Gfuk2dhEXpFDC3bYUEwq0PmE6FrXqcEK3i3phn0FJMFgDqDHC9qaYbGsMhhhC5-XM7o1L5wFLoOpwrMn0tQrz9a-D1nLKu2WrieqCpwU Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 277f039d5372403cae3f766dfd01c81c Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:30:41.767057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_277f039d5372403cae3f766dfd01c81c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/277f039d5372403cae3f766dfd01c81c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 277f039d5372403cae3f766dfd01c81c Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1263826696 Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesSnapshotsTestJSON-1263826696-project Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: ddbe4e9452c241bfbeddbdb5e51a865b Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1263826696-project Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '3749f326-1549-45f4-b1fe-6f439d1aa0c4'} Oct 03 13:30:41.768184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. (HTTP 404) (Request-ID: req-a92aa690-e9be-4c9d-8838-f73bf2e067ed) Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.768828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 03 13:30:41.769819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 03 13:30:41.771205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. Oct 03 13:30:41.773217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:30:41.777239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-14d82950-a78d-401f-be44-2909b75688b1 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] Returning 404 to user: Volume 3749f326-1549-45f4-b1fe-6f439d1aa0c4 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:30:41.777383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e402e75a-f742-4c52-a7b8-b53ad71ae200 tempest-VolumesTestJSON-172530048 tempest-VolumesTestJSON-172530048-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.443593 Oct 03 13:30:41.777900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-14d82950-a78d-401f-be44-2909b75688b1 tempest-VolumesSnapshotsTestJSON-1263826696 tempest-VolumesSnapshotsTestJSON-1263826696-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4" status: 404 len: 109 microversion: 2.1 time: 0.121060 Oct 03 13:30:41.778062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 20/44] 10.222.0.58 () {58 vars in 1155 bytes} [Mon Oct 3 13:30:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:41.778202 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 25/45] 10.222.0.58 () {58 vars in 1245 bytes} [Mon Oct 3 13:30:41 2022] GET /compute/v2.1/os-volumes/3749f326-1549-45f4-b1fe-6f439d1aa0c4 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:30:48.443221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1371423028", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "networks": [{"uuid": "c7f5133f-f533-43e9-8556-7d1b6afd965c"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:48.839295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] validate_networks() for [('c7f5133f-f533-43e9-8556-7d1b6afd965c', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:30:49.411948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7ff8f82c-8924-481a-928a-642323a32e38 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: .version_select at 0x7f7c22786820>, body: {"keypair": {"name": "tempest-keypair-1942204156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFGHuDTMUjA/3DG3jS04CI2XDL+CMaBxpUIo9Kh4V9IB935t+4a2rDlI0sWAN9+8Gzuoo7P+KGcOKeWWKsBOMNTDwwUJICaBGDjX5bKm4RAYVbS05UNnG07cgjCNAiq9g=="}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:49.638658 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-7ff8f82c-8924-481a-928a-642323a32e38 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:30:49.712690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-7ff8f82c-8924-481a-928a-642323a32e38 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for user 98de1ccbabc64162a29cbce2cfe11600 and project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:30:49.919078 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7ff8f82c-8924-481a-928a-642323a32e38 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.599399 Oct 03 13:30:49.923770 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 26/46] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:30:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:30:50.835087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1610142877", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:51.179374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] validate_networks() for [('289ad0fb-c675-48f9-ad56-9a68538f4eb7', None, None, None, None, None)] {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:30:51.841085 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:30:51.842638 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:30:51.845399 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:30:51.846194 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:30:51.846833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:30:51.893963 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:51.896790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:51.899306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:51.901703 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:51.902445 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:51.904343 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:51.996078 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Getting quotas for project 5f908aee304e4fe2bb2185d89400533c. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:30:52.015609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Getting quotas for user b8defdf430274affaed766d8aedccfad and project 5f908aee304e4fe2bb2185d89400533c. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:30:52.045193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:30:52.057637 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:30:52.256382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4fd611b8-8ab7-4ff7-8273-988e995911a7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.595721 Oct 03 13:30:52.272081 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 21/47] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:30:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 13:30:52.278684 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bc5c3efd-eeb9-45a5-9618-7e3c9f3905c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:52.279485 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bc5c3efd-eeb9-45a5-9618-7e3c9f3905c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:30:52.479825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bc5c3efd-eeb9-45a5-9618-7e3c9f3905c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:30:52.504115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bc5c3efd-eeb9-45a5-9618-7e3c9f3905c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1215 microversion: 2.1 time: 0.229003 Oct 03 13:30:52.505726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 22/48] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:30:52 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:53.549794 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-07f18be7-64ea-473e-a4ed-49b4d9f510c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:53.552121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-07f18be7-64ea-473e-a4ed-49b4d9f510c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:30:53.877568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-07f18be7-64ea-473e-a4ed-49b4d9f510c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:30:53.891541 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-07f18be7-64ea-473e-a4ed-49b4d9f510c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1215 microversion: 2.1 time: 0.347522 Oct 03 13:30:53.914891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 23/49] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:30:53 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1215 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:54.929379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2c4c1cab-4130-4ea8-bcee-9f9a939f9fb4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:54.931517 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2c4c1cab-4130-4ea8-bcee-9f9a939f9fb4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:30:55.107957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2c4c1cab-4130-4ea8-bcee-9f9a939f9fb4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:30:55.127962 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2c4c1cab-4130-4ea8-bcee-9f9a939f9fb4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1215 microversion: 2.1 time: 0.202689 Oct 03 13:30:55.156505 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 24/50] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:30:54 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:55.200819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:30:55.201751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:30:55.204602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:30:55.206039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:30:55.206980 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:30:55.276881 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:55.278679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:55.279445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:55.286365 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:55.288611 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:55.289611 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:55.470354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Getting quotas for project 557321bf33ca42df8d5d53e5157e6803. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:30:55.511891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Getting quotas for user ae71fd7ba4334d0d813cbc0c06e3686e and project 557321bf33ca42df8d5d53e5157e6803. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:30:55.585752 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:30:55.590371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:30:55.824060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c9440d44-029c-4d71-9281-af7af6ccb4e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.659653 Oct 03 13:30:55.824726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 27/51] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:30:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 5662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:30:55.847345 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-624a1f39-0d25-44d3-b0c0-c9c943a8d263 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:55.848268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-624a1f39-0d25-44d3-b0c0-c9c943a8d263 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:30:56.158102 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:56.158718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:30:56.214049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:56.217338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:56.220204 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:56.221317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:56.227663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:56.228860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:56.240081 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-624a1f39-0d25-44d3-b0c0-c9c943a8d263 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:30:56.250996 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-624a1f39-0d25-44d3-b0c0-c9c943a8d263 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1222 microversion: 2.1 time: 0.408810 Oct 03 13:30:56.255087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 25/52] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:30:55 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1222 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:56.316773 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-849637686", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff8319e2-24e1-46c8-a6e2-568f9c4503d6"}], "security_groups": [{"name": "tempest-securitygroup--1643391679"}], "key_name": "tempest-keypair-1942204156", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:56.610419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:30:56.635074 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2b660bfc-9241-435c-9422-897c54465a9e tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1211 microversion: 2.1 time: 0.481923 Oct 03 13:30:56.636551 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 28/53] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:30:56 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1211 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:56.916201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] validate_networks() for [('ff8319e2-24e1-46c8-a6e2-568f9c4503d6', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:30:57.035948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1574479888", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:30:57.259862 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] validate_networks() for [('289ad0fb-c675-48f9-ad56-9a68538f4eb7', None, None, None, None, None)] {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:30:58.376457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:30:58.377363 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:30:58.378648 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:30:58.379409 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:30:58.387014 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:30:58.439582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:58.443420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:58.444575 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:58.451216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:58.452761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:58.456739 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:58.561334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:30:58.566607 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for user 98de1ccbabc64162a29cbce2cfe11600 and project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:30:58.602969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:30:58.605662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:30:58.711069 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b66dc20f-9708-4acf-be8c-b1a0fa871e10 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.401810 Oct 03 13:30:58.714665 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 26/54] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:30:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:30:58.735985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:58.736758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:30:58.770055 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:58.770551 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:58.771097 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:58.771750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:30:58.772225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:30:58.772668 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:30:59.099332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:30:59.126799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1806228a-ae13-4f0a-bc5f-87aab1fc9fa2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1273 microversion: 2.1 time: 0.410610 Oct 03 13:30:59.146175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 27/55] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:30:58 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1273 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:30:59.164355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da459f2e-55c0-4dfc-ae8d-8dc5baa954c0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:30:59.165134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da459f2e-55c0-4dfc-ae8d-8dc5baa954c0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:30:59.532985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da459f2e-55c0-4dfc-ae8d-8dc5baa954c0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:30:59.548773 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da459f2e-55c0-4dfc-ae8d-8dc5baa954c0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1241 microversion: 2.1 time: 0.401369 Oct 03 13:30:59.554183 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 28/56] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:30:59 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1241 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:00.178602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:00.182157 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:00.209331 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:00.210726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:00.212554 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:00.216155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:00.218576 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:00.220171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:00.450208 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:00.478657 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-23d0e1ee-8138-4426-996e-8f57e1697af7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1273 microversion: 2.1 time: 0.308916 Oct 03 13:31:00.479595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 29/57] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:00 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1273 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:00.604226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-929b1285-2076-4f9d-b608-c9beebb571b0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:00.605310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-929b1285-2076-4f9d-b608-c9beebb571b0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:00.926205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-929b1285-2076-4f9d-b608-c9beebb571b0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:00.956993 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-929b1285-2076-4f9d-b608-c9beebb571b0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1241 microversion: 2.1 time: 0.343478 Oct 03 13:31:00.993129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 30/58] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:00 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1241 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:01.534031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:01.575276 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:01.640824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:01.656463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:01.657433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:01.679940 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:01.680910 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:01.684274 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:02.235386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:02.271647 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0577c359-bc19-42bb-9840-5ec8b26b8d50 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1273 microversion: 2.1 time: 0.745160 Oct 03 13:31:02.287385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 31/59] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:01 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1273 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:02.325778 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:02.327929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:02.403619 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:02.406053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:02.407221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:02.415541 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:02.421214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:02.422434 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:02.968931 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:31:02.971030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:31:02.972481 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:31:02.973774 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:31:02.974671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:31:03.028043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:03.028993 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:03.030977 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:03.040206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:03.041142 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:03.044221 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:03.063375 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:03.102188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ab3ba551-2312-4c20-bb28-4e3de188120f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1293 microversion: 2.1 time: 0.801111 Oct 03 13:31:03.125999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 32/60] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:02 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1293 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:03.178682 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Getting quotas for project 557321bf33ca42df8d5d53e5157e6803. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:31:03.214108 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Getting quotas for user ae71fd7ba4334d0d813cbc0c06e3686e and project 557321bf33ca42df8d5d53e5157e6803. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:31:03.316074 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:31:03.323488 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:31:03.369801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:03.380696 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:03.455109 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:03.456614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:03.464327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:03.471868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:03.474432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:03.478653 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:03.566348 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-af4c9bdd-bb18-4778-899a-bfac4af3742a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.527083 Oct 03 13:31:03.569534 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 29/61] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:30:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 6541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 13:31:03.610159 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cb24b09d-5caa-47b4-8485-9e9121b3cea9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:03.638842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-cb24b09d-5caa-47b4-8485-9e9121b3cea9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:03.905868 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cb24b09d-5caa-47b4-8485-9e9121b3cea9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:03.945641 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cb24b09d-5caa-47b4-8485-9e9121b3cea9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1222 microversion: 2.1 time: 0.352875 Oct 03 13:31:03.953865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 30/62] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:03 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1222 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:04.079384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:04.097677 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-01ed26d9-2be8-48f6-9bfe-642a7cc404c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1273 microversion: 2.1 time: 0.768105 Oct 03 13:31:04.099747 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 33/63] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:03 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1273 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:04.150945 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:04.152609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:04.184643 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:04.187098 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:04.191773 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:04.195846 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:04.196773 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:04.200419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:04.984737 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-68965a51-6f2b-459e-9048-d211990c6b95 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:04.986142 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-68965a51-6f2b-459e-9048-d211990c6b95 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:05.159096 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:05.173015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-42ca4ab0-34f9-4cd2-96ae-eb9386210e1f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1299 microversion: 2.1 time: 1.028900 Oct 03 13:31:05.191598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 31/64] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:04 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1299 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:05.211718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:05.212634 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:05.257713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:05.266484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:05.268340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:05.275832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:05.279214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:05.283172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:05.578422 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-68965a51-6f2b-459e-9048-d211990c6b95 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:05.612153 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-68965a51-6f2b-459e-9048-d211990c6b95 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1222 microversion: 2.1 time: 0.633764 Oct 03 13:31:05.614867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 34/65] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:04 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1222 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:06.204099 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:06.205010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:06.228676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:06.239343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d3039137-f901-46cc-97c0-cc34cf4d38e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 1.047854 Oct 03 13:31:06.241485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 32/66] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:05 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:06.271628 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:06.273155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:06.274830 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:06.280864 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:06.282137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:06.283749 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:06.592836 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:06.650527 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:06.652476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-978549ee-6be2-4099-869d-bc67938916de tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1299 microversion: 2.1 time: 0.436100 Oct 03 13:31:06.657894 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:06.660837 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 35/67] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:06 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1299 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:06.680529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:06.681391 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:06.684597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:06.686068 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:06.686866 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:06.687629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:06.913917 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:06.925727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4f3124ef-2bc2-44e4-931c-756fe3aa80d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1218 microversion: 2.1 time: 0.287642 Oct 03 13:31:06.926350 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 33/68] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:06 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:07.272334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:07.274326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:07.287677 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:07.288603 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:07.289547 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:07.292154 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:07.293924 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:07.294732 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:07.679933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:07.680864 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:07.690422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:07.690927 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:07.692930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:07.698099 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:07.698627 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:07.699089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:07.743453 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:07.766389 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d442cb4f-a082-483c-a152-ad3ff7fb1ea2 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.503486 Oct 03 13:31:07.782018 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 36/69] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:07 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:07.953777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:07.954166 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:07.973927 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:07.974710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:07.975370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:07.976476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:07.987103 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:07.988838 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:08.085378 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:08.096859 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-bb8d960f-6788-4f78-9333-263a4175080b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.422045 Oct 03 13:31:08.126353 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 34/70] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:07 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:08.238298 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:08.284375 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d2781426-e037-49c3-a418-99be2d4d0840 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1218 microversion: 2.1 time: 0.335781 Oct 03 13:31:08.301997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 37/71] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:07 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1218 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:08.827390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:08.829677 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:08.842857 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:08.853268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:08.854792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:08.859060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:08.860581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:08.862052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:09.132814 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:09.148569 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:09.150929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:09.164359 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:09.168816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:09.170175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:09.171297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:09.175003 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:09.176159 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:09.176413 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-85f26c2c-3c72-4d10-a2f4-a59d9fbd9b9c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.356732 Oct 03 13:31:09.177963 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:09.193503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 35/72] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:08 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:09.338536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:09.340366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:09.357378 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:09.359928 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:09.361653 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:09.362840 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:09.364087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:09.364957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:09.614503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:09.624884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b64567a4-94e2-4048-80bb-86b7eb1f9af7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1218 microversion: 2.1 time: 0.294721 Oct 03 13:31:09.658152 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 36/73] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:09 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1218 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:09.689978 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:09.709433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3c49ff28-7f0b-4c8d-a26a-698715940d2a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.571668 Oct 03 13:31:09.735837 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 38/74] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:09 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:10.235143 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:10.236318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:10.281037 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:10.292840 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:10.294960 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:10.302461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:10.306801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:10.308988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:10.678386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:10.680811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:10.727468 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:10.735495 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:10.737777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:10.743357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:10.747469 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:10.752832 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:11.312587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:11.329092 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-aee73229-0755-4cf4-bab9-89e9f84fe512 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1274 microversion: 2.1 time: 0.663244 Oct 03 13:31:11.338481 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 39/75] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:10 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1274 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:11.363849 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:11.368665 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:11.429942 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:11.430803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:11.431538 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:11.432803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:11.450182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:11.451202 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:12.787943 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:12.813254 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:12.866975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5266a2ed-1552-4c95-93a7-898b0b858015 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 1.526538 Oct 03 13:31:12.872577 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 40/76] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:11 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:12.875734 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d067cff8-4fd4-4436-ab13-e57b053ef23c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 2.656305 Oct 03 13:31:12.882807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 37/77] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:10 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 2664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:12.898956 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:12.908163 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:12.923864 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:12.925165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:12.926463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:12.928064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:12.929639 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:12.931134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:13.281184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:13.296868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-934f90a9-e964-48c7-92fa-36eee6ac1a49 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1280 microversion: 2.1 time: 0.419027 Oct 03 13:31:13.300014 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 41/78] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:12 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1280 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:13.918009 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:13.927444 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:13.930006 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:13.931195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:13.958075 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:13.963236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:13.964991 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=18 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:13.965711 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:13.966383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:13.967709 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:13.968355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:13.969708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:14.020332 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:14.023188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:14.031451 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:14.034396 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:14.041893 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:14.043804 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:15.249367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:15.269291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7f974824-feab-4cc9-aaf9-93fdafc425c9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 1.363337 Oct 03 13:31:15.269291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 38/79] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:13 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:15.304077 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:15.317911 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:15.361483 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:15.364487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:15.365381 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:15.366341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:15.369718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:15.370329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:15.391855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:15.404914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b0018092-542e-4ca2-9608-d67b7b991e08 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 1.487997 Oct 03 13:31:15.404914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 42/80] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:13 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:15.598720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=26 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:15.673410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:15.687243 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e9c47598-1830-46b4-9b98-da230b8d9397 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1280 microversion: 2.1 time: 0.387250 Oct 03 13:31:15.687940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 39/81] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:15 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1280 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:16.251248 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-91045945-8895-4b9d-96ea-41e52880f4e2 req-57f4b5a4-3bde-4ad6-b81c-e0c524fa76dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a9ff191-d009-41e4-9966-44fe462252b5", "tag": "316014ae-7577-478c-97b0-af9327de5aca"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:16.306943 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:16.311354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:16.367216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-91045945-8895-4b9d-96ea-41e52880f4e2 req-57f4b5a4-3bde-4ad6-b81c-e0c524fa76dd service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:16.367216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-91045945-8895-4b9d-96ea-41e52880f4e2 req-57f4b5a4-3bde-4ad6-b81c-e0c524fa76dd service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:16.380271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-91045945-8895-4b9d-96ea-41e52880f4e2 req-57f4b5a4-3bde-4ad6-b81c-e0c524fa76dd service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:16.388290 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:16.391210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:16.397268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:16.399691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:16.401353 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:16.404963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:16.461268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-91045945-8895-4b9d-96ea-41e52880f4e2 req-57f4b5a4-3bde-4ad6-b81c-e0c524fa76dd service nova] Creating event network-changed:316014ae-7577-478c-97b0-af9327de5aca for instance 7a9ff191-d009-41e4-9966-44fe462252b5 on hv-cinder-86009 Oct 03 13:31:16.465194 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-91045945-8895-4b9d-96ea-41e52880f4e2 req-57f4b5a4-3bde-4ad6-b81c-e0c524fa76dd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 13:31:16.466223 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-91045945-8895-4b9d-96ea-41e52880f4e2 req-57f4b5a4-3bde-4ad6-b81c-e0c524fa76dd service nova] Acquired lock "compute-rpcapi-router" {{(pid=120743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 13:31:16.468631 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:16.469389 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:16.475826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:16.480867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:16.484109 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:16.487295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:16.537160 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.compute.rpcapi [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 13:31:16.541801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 13:31:16.595462 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b05dc82c-3c5e-4916-8d94-9bc87d1d27c0 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.189582 Oct 03 13:31:16.601310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 43/82] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:31:16.620380 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:16.623762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:16.650965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:16.654325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:16.656499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:16.660010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:16.662880 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:16.665349 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:17.372694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:17.399931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c39989d5-c54d-4e42-b566-e89424669ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.788921 Oct 03 13:31:17.401043 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 44/83] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:16 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:17.416292 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:17.418068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:17.435988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:17.437987 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:17.439822 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:17.442270 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:17.443263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:17.444551 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:18.173379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:18.202822 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4e1a81ad-db98-4642-8184-10aef90dccf2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.797609 Oct 03 13:31:18.208122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 45/84] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:17 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:18.691926 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-4a59d0d2-ae1d-4cf7-89b1-9b976f4cf09e req-4d21c22e-ee1c-4306-a248-57e9fc2dbf1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7a7e49-20a7-45bc-bc98-7af878fc50a8", "tag": "4e8541e0-b0c3-4cae-a985-b4e2dfec4290"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:18.731439 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:18.768444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4a59d0d2-ae1d-4cf7-89b1-9b976f4cf09e req-4d21c22e-ee1c-4306-a248-57e9fc2dbf1a service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:18.769432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4a59d0d2-ae1d-4cf7-89b1-9b976f4cf09e req-4d21c22e-ee1c-4306-a248-57e9fc2dbf1a service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:18.770438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4a59d0d2-ae1d-4cf7-89b1-9b976f4cf09e req-4d21c22e-ee1c-4306-a248-57e9fc2dbf1a service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:18.793276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:18.807889 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=69 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:18.822805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f55a3b9e-63f9-4f2b-bff6-f0eeb54e50fa tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 2.529652 Oct 03 13:31:18.825251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 40/85] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:16 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:18.834688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=99 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:18.846891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-4a59d0d2-ae1d-4cf7-89b1-9b976f4cf09e req-4d21c22e-ee1c-4306-a248-57e9fc2dbf1a service nova] Creating event network-changed:4e8541e0-b0c3-4cae-a985-b4e2dfec4290 for instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 on hv-cinder-86009 Oct 03 13:31:18.852331 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:18.859390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:18.862107 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:18.871290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-4a59d0d2-ae1d-4cf7-89b1-9b976f4cf09e req-4d21c22e-ee1c-4306-a248-57e9fc2dbf1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.660337 Oct 03 13:31:18.884680 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 46/86] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:31:18.901582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-05e63274-3036-46b1-8c2d-2c17a80acdeb req-07091113-c1ad-42ca-a3bd-5cf525f85ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81de33cc-ab4f-402c-bc77-a8818e85ad75", "tag": "a1d48bcc-c2cd-4550-b46c-0b4470912f16"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:18.901956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:18.902634 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:18.903235 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:18.904979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:18.906070 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:18.906669 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:18.938026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-05e63274-3036-46b1-8c2d-2c17a80acdeb req-07091113-c1ad-42ca-a3bd-5cf525f85ef8 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:18.942859 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-05e63274-3036-46b1-8c2d-2c17a80acdeb req-07091113-c1ad-42ca-a3bd-5cf525f85ef8 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:18.943754 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-05e63274-3036-46b1-8c2d-2c17a80acdeb req-07091113-c1ad-42ca-a3bd-5cf525f85ef8 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:19.010203 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-05e63274-3036-46b1-8c2d-2c17a80acdeb req-07091113-c1ad-42ca-a3bd-5cf525f85ef8 service nova] Creating event network-changed:a1d48bcc-c2cd-4550-b46c-0b4470912f16 for instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 on hv-cinder-86009 Oct 03 13:31:19.038617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-05e63274-3036-46b1-8c2d-2c17a80acdeb req-07091113-c1ad-42ca-a3bd-5cf525f85ef8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145131 Oct 03 13:31:19.041130 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 47/87] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:31:19.238171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:19.240308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:19.258199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:19.260109 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:19.260902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:19.262119 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:19.262903 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:19.264306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:19.391380 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:19.409417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b41672d1-ff8d-47ef-a4e4-ba49c8af844d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.576498 Oct 03 13:31:19.410157 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 41/88] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:18 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:19.879883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:19.880911 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:19.893418 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:19.893954 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:19.894405 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:19.895244 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:19.895828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:19.896172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:19.901394 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:19.921488 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-55ec1b53-a0f2-4bc0-9104-8493cdf04f4c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.690360 Oct 03 13:31:19.922124 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 48/89] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:19 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:20.167152 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:20.178988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-66f7f1bd-67de-4d75-b9b4-af8cf7b0de90 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.303205 Oct 03 13:31:20.180177 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 42/90] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:19 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:20.458256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:20.460980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:20.481290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:20.484358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:20.486051 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:20.487979 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:20.489820 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:20.490887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:20.724168 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:20.735108 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6884cbf1-cd49-479b-9ece-7a3043b72d0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.289443 Oct 03 13:31:20.736213 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 49/91] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:20 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:20.927476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-eaab2f83-b019-4d31-8d2b-d62d92113e21 req-330d40a2-34e5-4440-a722-ce33535fb7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46d2be3-6cca-411b-8b83-b13d51f53463", "tag": "9b784b63-7dc9-4c53-835b-6c3039d2f205"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:20.942438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-eaab2f83-b019-4d31-8d2b-d62d92113e21 req-330d40a2-34e5-4440-a722-ce33535fb7eb service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:20.943362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-eaab2f83-b019-4d31-8d2b-d62d92113e21 req-330d40a2-34e5-4440-a722-ce33535fb7eb service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:20.944066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-eaab2f83-b019-4d31-8d2b-d62d92113e21 req-330d40a2-34e5-4440-a722-ce33535fb7eb service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:20.947817 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:20.948674 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:20.961401 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:20.966206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:20.967431 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:20.968920 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-eaab2f83-b019-4d31-8d2b-d62d92113e21 req-330d40a2-34e5-4440-a722-ce33535fb7eb service nova] Creating event network-changed:9b784b63-7dc9-4c53-835b-6c3039d2f205 for instance f46d2be3-6cca-411b-8b83-b13d51f53463 on hv-cinder-86009 Oct 03 13:31:20.969838 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-eaab2f83-b019-4d31-8d2b-d62d92113e21 req-330d40a2-34e5-4440-a722-ce33535fb7eb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120742) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 03 13:31:20.970258 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:20.970694 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-eaab2f83-b019-4d31-8d2b-d62d92113e21 req-330d40a2-34e5-4440-a722-ce33535fb7eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=120742) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 03 13:31:20.972078 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:20.972938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:20.974160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:20.975094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:20.975867 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:20.976492 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:20.982996 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:20.983571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:20.990593 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.compute.rpcapi [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 03 13:31:20.991924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] Releasing lock "compute-rpcapi-router" {{(pid=120742) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 03 13:31:21.012906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3745ab59-2419-46e2-ace2-5a3527dbcf87 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088950 Oct 03 13:31:21.018938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 43/92] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:31:21.205393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:21.206163 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:21.224717 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:21.229111 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:21.237211 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:21.238177 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:21.240213 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:21.240913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:21.242110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:21.243508 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3eea3699-9516-4a73-9874-3bdd6295a118 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.299236 Oct 03 13:31:21.244905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 50/93] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:20 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:21.599772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:21.621655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-45e0356f-010f-4329-ab01-65a29c69e8a8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.422301 Oct 03 13:31:21.645495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 44/94] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:21 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:21.764544 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:21.766195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:21.779022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:21.785788 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:21.786601 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:21.787928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:21.788811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:21.789558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:22.031355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:22.054130 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-62b5e6e1-adb8-4963-9887-e576c70945ef tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.297493 Oct 03 13:31:22.056731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 51/95] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:21 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:22.275123 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:22.278197 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:22.292477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:22.296401 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:22.297966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:22.299695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:22.300903 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:22.301945 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:22.633267 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:22.658157 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-24327e1d-e1a4-4151-bda5-ffebc04c4d7c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.392175 Oct 03 13:31:22.686362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:22.687345 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:22.692714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 45/96] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:22 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:22.697582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:22.698807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:22.699612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:22.701635 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:22.702889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:22.703629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:23.088177 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:23.089911 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:23.108399 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:23.111004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:23.112185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:23.114251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:23.116564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:23.117888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:23.153842 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:23.170940 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f4b07069-0cd5-4d79-af26-8d4f9c8720c4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.490670 Oct 03 13:31:23.172280 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 52/97] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:22 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:23.426946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:23.441274 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0074da49-a8ca-4f54-9440-119fe0dd0a35 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.362193 Oct 03 13:31:23.441909 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 46/98] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:23 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:23.690442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:23.692446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:23.706657 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:23.708440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:23.710804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:23.713158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:23.714693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:23.715472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:24.208329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:24.208955 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:24.230293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:24.230798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:24.233814 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:24.234714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:24.235238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:24.237534 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:24.243469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:24.247431 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c1d7555e-7fd5-47ec-badd-f55542b863f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.565909 Oct 03 13:31:24.248963 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 53/99] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:23 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:24.469409 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:24.470729 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:24.485778 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:24.487345 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:24.488364 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:24.489880 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:24.490870 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:24.491799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:24.504574 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:24.515663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-153e7ac9-1f18-478b-81c8-a065c0235a37 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.311134 Oct 03 13:31:24.516266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 47/100] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:24 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:24.836225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:24.865054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b50af735-35e5-484d-8930-4ddf781af748 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.402667 Oct 03 13:31:24.889067 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 54/101] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:24 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:25.281477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:25.281477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:25.295876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:25.296644 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:25.297829 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:25.299161 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:25.300430 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:25.301781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:25.523952 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:25.562561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4c75fef1-5f19-4be7-ac5c-7e94359d1fb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.289761 Oct 03 13:31:25.567433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:25.569581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 48/102] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:25 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:25.570358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:25.604495 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:25.608074 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:25.610057 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:25.612678 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:25.613989 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:25.614969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:25.921931 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:25.923011 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:25.943023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:25.943508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:25.943953 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:25.948467 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:25.949113 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:25.949584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:26.029055 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:26.040749 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f38c9cc1-e282-4410-9f16-20852dc008b6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.481804 Oct 03 13:31:26.043515 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 55/103] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:25 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:26.487663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:26.505131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3016f9da-e74d-4be2-8271-27f152da45fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.589920 Oct 03 13:31:26.507485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 49/104] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:25 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:26.589756 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:26.593594 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:26.608775 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:26.614435 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:26.616054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:26.617148 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:26.619404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:26.620769 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:26.622366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:27.002396 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:27.021274 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cd5beace-0186-4dc6-b721-0331e8ae51aa tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.436417 Oct 03 13:31:27.023201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 56/105] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:26 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:27.087303 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:27.089225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:27.097348 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:27.097906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:27.098349 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:27.099068 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:27.099726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:27.100151 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:27.516522 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:27.525755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5e873063-69ec-4f41-8894-f61502862e0f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.445461 Oct 03 13:31:27.526355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 50/106] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:27 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:27.552565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:27.553190 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:27.560946 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:27.561636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:27.562185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:27.562921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:27.563381 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:27.563808 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:27.804304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:27.839688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1af2eb40-56e5-4c2e-b5d1-f1e7bf5d1b3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.287671 Oct 03 13:31:27.840366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 57/107] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:27 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:28.086386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:28.089360 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:28.102682 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:28.104961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:28.106371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:28.108868 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:28.110257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:28.111377 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:28.425194 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:28.440583 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-da89804d-b647-412d-80e6-ad1da0a3fb3d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.377558 Oct 03 13:31:28.457491 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 51/108] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:28 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:28.552937 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:28.553780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:28.567178 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:28.567872 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:28.568669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:28.569599 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:28.570122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:28.570557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:28.875155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:28.876351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:28.891495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:28.894752 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:28.897088 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:28.899291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:28.901909 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:28.903280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:29.042802 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:29.083986 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6d83f387-a8b6-4ffd-a571-bf0b73668c87 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.535529 Oct 03 13:31:29.084332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 58/109] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:28 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:29.490206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:29.491756 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:29.505922 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:29.507647 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:29.508812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:29.511413 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:29.512507 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:29.513306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:30.140087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:30.183891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0bba7890-85cb-4d7b-a620-d8b7d883f804 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 1.315299 Oct 03 13:31:30.197739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 52/110] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:28 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:30.237566 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:30.240015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:30.267474 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:30.272453 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:30.273416 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:30.276345 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:30.282396 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:30.283394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:30.811812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:30.831278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a55d45cb-8e30-421c-810f-cc1f36866097 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 1.354245 Oct 03 13:31:30.836294 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 59/111] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:29 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:30.989946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:31.230098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:31.231190 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:31.241565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:31.246066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:31.249518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:31.250705 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:31.258402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:31.258929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:31.338063 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:31.369926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-fb1623ab-ec53-40f6-a7a9-97dbcd87ee01 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 1.170180 Oct 03 13:31:31.373623 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 53/112] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:30 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:31.636796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:31.649486 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-883b23f6-dbb8-4fe2-b1b8-fd348a6e8ea3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.424829 Oct 03 13:31:31.659375 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 60/113] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:31 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:31.869234 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:31.871226 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:31.891446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:31.892811 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:31.894014 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:31.895843 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:31.897034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:31.898260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:32.226801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:32.246945 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-063bf8b4-194a-4ae2-beb3-a47d7de6e041 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.389042 Oct 03 13:31:32.251094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 54/114] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:31 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:32.417111 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:32.418325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:32.433274 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:32.434137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:32.435453 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:32.437869 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:32.438742 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:32.439543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:32.651884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:32.662588 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d0259d28-ae64-4a18-887b-99df4737149f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.253589 Oct 03 13:31:32.663385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 61/115] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:32 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:32.683982 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:32.686245 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:32.693728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:32.694476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:32.695032 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:32.695847 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:32.696417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:32.696935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:32.917798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:32.928131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-142035f4-aa07-4b18-8a6c-59c09a1cfb22 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.247991 Oct 03 13:31:32.928834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 55/116] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:32 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:33.297204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:33.299230 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:33.311021 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:33.312187 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:33.313188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:33.314672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:33.316626 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:33.317913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:33.594190 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:33.603511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6a94423f-32c2-46cd-9063-410952047198 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.313849 Oct 03 13:31:33.604129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 62/117] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:33 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:33.701211 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:33.702043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:33.709174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:33.709694 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:33.710132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:33.710845 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:33.711297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:33.711718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:33.875879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:33.884901 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-10e8e977-a076-4373-bf64-90d3faafa636 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.188378 Oct 03 13:31:33.885531 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 56/118] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:33 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:33.956881 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:33.957760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:33.965975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:33.967069 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:33.967683 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:33.968520 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:33.969124 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:33.969706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:34.131717 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:34.141176 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-34ca9854-eedb-4a70-acff-efb07dfd7c7a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.189192 Oct 03 13:31:34.141831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 63/119] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:33 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:34.630229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:34.631049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:34.638818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:34.639421 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:34.639950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:34.640807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:34.641307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:34.641839 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:34.805203 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:34.808386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=100 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:34.821741 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-06bc8760-7ba2-425e-a202-0caec77c1e53 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.195793 Oct 03 13:31:34.822825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 57/120] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:34 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:34.910805 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:34.911735 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:34.920165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:34.921029 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:34.921590 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:34.922470 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:34.922985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:34.923472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:34.926881 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:35.085943 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:35.095085 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4f6a2703-b02a-42e8-ad17-37cb1989e0bd tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.188801 Oct 03 13:31:35.095795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 64/121] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:34 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:35.181095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:35.181729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:35.189143 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:35.189810 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:35.190356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:35.191180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:35.191732 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:35.192252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:35.353046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:35.367737 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-638019a2-c685-4878-a940-10cafcf0d297 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.190482 Oct 03 13:31:35.368835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 58/122] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:35 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:35.871304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:35.872746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:35.884072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:35.884823 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:35.885373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:35.886198 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:35.886751 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:35.887301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:36.084698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:36.124932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:36.127039 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-19adc23a-ad0e-4196-90ca-8a0bf457e033 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.266569 Oct 03 13:31:36.128859 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:36.135483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 65/123] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:35 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:36.143357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:36.144269 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:36.145180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:36.146526 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:36.147335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:36.148135 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:36.337912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:36.348826 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3acc9d2b-3f6b-484b-95a2-02589059a91f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.231652 Oct 03 13:31:36.349762 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 59/124] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:36 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:36.394415 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:36.395112 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:36.402679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:36.403485 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:36.404637 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:36.405626 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:36.406192 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:36.406701 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:36.579472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:36.588005 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c47b5f37-9619-425f-bba1-a5158baf0b94 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.197361 Oct 03 13:31:36.588605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 66/125] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:36 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:37.183490 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:37.184574 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:37.191885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:37.192390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:37.192856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:37.193685 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:37.194256 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:37.194709 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:37.354854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:37.364855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-878e441b-822a-4466-83ec-8754cf53f71c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.188605 Oct 03 13:31:37.365655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 60/126] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:37 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:37.385222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:37.386139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:37.392795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:37.393386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:37.393873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:37.394591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:37.395103 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:37.395526 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:37.616148 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:37.617007 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:37.628664 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:37.629856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:37.631028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:37.632088 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:37.633153 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:37.634253 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:37.650012 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:37.677290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-57e5f906-d3d9-404b-b7b9-b58f33760bf6 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.297522 Oct 03 13:31:37.678228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 67/127] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:37 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:37.900799 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:37.911285 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0d01909b-de45-444c-8f7e-b3af32085985 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.301520 Oct 03 13:31:37.912232 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 61/128] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:37 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:38.390386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:38.391307 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:38.398792 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:38.399494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:38.400249 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:38.401276 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:38.401998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:38.402500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:38.571171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:38.585481 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-426291d2-9f4d-4caf-ab78-8dac33920000 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.199335 Oct 03 13:31:38.586543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 68/129] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:38 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:38.715989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:38.729669 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:38.746672 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:38.748164 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:38.749696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:38.751567 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:38.752492 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:38.753613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:38.953100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:38.954971 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:38.982803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:38.986662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:38.989819 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:38.992935 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:38.995249 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:38.996933 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:39.042355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:39.064263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9b077807-a5e1-4958-a664-b88063556bd5 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.352456 Oct 03 13:31:39.091401 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 62/130] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:38 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:39.344609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:39.365077 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-77e20e61-1d6c-4d32-bb80-c72a87cb6b1a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.420491 Oct 03 13:31:39.381587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 69/131] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:38 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:39.626819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:39.628916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:39.644541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:39.646835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:39.648418 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:39.651382 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:39.652239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:39.653041 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:40.002680 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:40.016457 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6f2c56bd-3a72-48ce-989e-412aec923961 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.402554 Oct 03 13:31:40.018929 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 63/132] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:39 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:40.099445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:40.100520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:40.108609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:40.109115 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:40.109606 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:40.110562 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:40.111017 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:40.111453 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:40.229015 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-18ef3a60-4a1c-4914-864c-ed81d1a92d10 req-f25796dd-d8b4-41d3-bdf1-aa7eef3af97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9ff191-d009-41e4-9966-44fe462252b5", "name": "network-vif-plugged", "status": "completed", "tag": "316014ae-7577-478c-97b0-af9327de5aca"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:40.251899 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-18ef3a60-4a1c-4914-864c-ed81d1a92d10 req-f25796dd-d8b4-41d3-bdf1-aa7eef3af97b service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:40.255186 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-18ef3a60-4a1c-4914-864c-ed81d1a92d10 req-f25796dd-d8b4-41d3-bdf1-aa7eef3af97b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:40.260733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-18ef3a60-4a1c-4914-864c-ed81d1a92d10 req-f25796dd-d8b4-41d3-bdf1-aa7eef3af97b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:40.286249 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-18ef3a60-4a1c-4914-864c-ed81d1a92d10 req-f25796dd-d8b4-41d3-bdf1-aa7eef3af97b service nova] Creating event network-vif-plugged:316014ae-7577-478c-97b0-af9327de5aca for instance 7a9ff191-d009-41e4-9966-44fe462252b5 on hv-cinder-86009 Oct 03 13:31:40.301248 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-18ef3a60-4a1c-4914-864c-ed81d1a92d10 req-f25796dd-d8b4-41d3-bdf1-aa7eef3af97b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266701 Oct 03 13:31:40.328843 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 70/133] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:31:40.408799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:40.409584 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:40.432301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:40.436018 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:40.436825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:40.440809 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:40.441571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:40.447447 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:40.492595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:40.523154 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-46ef144e-9f00-4390-8f10-ebfe1816f746 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.427154 Oct 03 13:31:40.534749 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 64/134] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:40 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:40.802057 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:40.820997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bfcd15a1-3888-4532-af76-d7c9e757cb15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.418977 Oct 03 13:31:40.839444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 71/135] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:40 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:41.052502 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:41.053673 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:41.063201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:41.063926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:41.065500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:41.066809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:41.067337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:41.068379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:41.327541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:41.345153 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cc96f81d-e730-4cad-b39c-4148efea8f9e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.298765 Oct 03 13:31:41.347850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 65/136] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:41 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:41.587380 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:41.590521 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:41.607984 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:41.609266 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:41.610358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:41.611562 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:41.613608 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:41.614581 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:41.839864 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:41.858317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:41.859438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:41.875451 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-aa90e01c-f863-48e3-87bf-a76fb15690e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.300390 Oct 03 13:31:41.875868 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:41.876751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:41.877795 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:41.878823 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 72/137] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:41 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:41.880285 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:41.881125 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:41.881923 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:42.143241 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:42.154928 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e2bcea45-dda7-4c90-84bf-b3599a2cf3df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.306299 Oct 03 13:31:42.155889 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 66/138] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:41 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:42.363475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-a8790678-a2e1-4df1-ac30-ccb54cd9c714 req-ad96eea1-66f5-49b4-bc42-866d1541899a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81de33cc-ab4f-402c-bc77-a8818e85ad75", "name": "network-vif-plugged", "status": "completed", "tag": "a1d48bcc-c2cd-4550-b46c-0b4470912f16"}, {"server_uuid": "4b7a7e49-20a7-45bc-bc98-7af878fc50a8", "name": "network-vif-plugged", "status": "completed", "tag": "4e8541e0-b0c3-4cae-a985-b4e2dfec4290"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:42.381858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:42.382643 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:42.391291 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a8790678-a2e1-4df1-ac30-ccb54cd9c714 req-ad96eea1-66f5-49b4-bc42-866d1541899a service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:42.391638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:42.392199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a8790678-a2e1-4df1-ac30-ccb54cd9c714 req-ad96eea1-66f5-49b4-bc42-866d1541899a service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:42.392406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:42.392982 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a8790678-a2e1-4df1-ac30-ccb54cd9c714 req-ad96eea1-66f5-49b4-bc42-866d1541899a service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:42.394180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:42.394950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:42.395462 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:42.395899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:42.454446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-a8790678-a2e1-4df1-ac30-ccb54cd9c714 req-ad96eea1-66f5-49b4-bc42-866d1541899a service nova] Creating event network-vif-plugged:a1d48bcc-c2cd-4550-b46c-0b4470912f16 for instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 on hv-cinder-86009 Oct 03 13:31:42.455676 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-a8790678-a2e1-4df1-ac30-ccb54cd9c714 req-ad96eea1-66f5-49b4-bc42-866d1541899a service nova] Creating event network-vif-plugged:4e8541e0-b0c3-4cae-a985-b4e2dfec4290 for instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 on hv-cinder-86009 Oct 03 13:31:42.473730 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-a8790678-a2e1-4df1-ac30-ccb54cd9c714 req-ad96eea1-66f5-49b4-bc42-866d1541899a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.117746 Oct 03 13:31:42.474804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 73/139] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:31:42.711821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:42.721398 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a1a10e09-34ee-423a-a3f2-8ae7fcd578b0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.345974 Oct 03 13:31:42.722109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 67/140] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:42 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:42.914884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:42.915657 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:42.923707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:42.924377 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:42.925163 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:42.926296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:42.926854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:42.927296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:43.120337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:43.131540 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e6384edf-5f4a-4403-9179-5d4bad80091c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.224678 Oct 03 13:31:43.134699 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 74/141] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:42 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:43.196785 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:43.198817 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:43.214917 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:43.215790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:43.217143 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:43.218384 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:43.219178 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:43.219906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:43.409401 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:43.423115 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3a494cc4-ce46-4707-9b86-4bebcbf0390a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.233640 Oct 03 13:31:43.424722 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 68/142] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:43 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:43.766083 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:43.767044 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:43.774253 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:43.775107 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:43.775557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:43.776384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:43.776906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:43.777632 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:44.162598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:44.163762 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:44.190421 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:44.195803 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:44.196774 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:44.198033 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:44.199557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:44.200826 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:44.204531 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:44.239828 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bc8fd422-24bd-4618-a7ef-035b5b82d909 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.478152 Oct 03 13:31:44.241434 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 75/143] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:43 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:44.457583 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:44.459432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:44.472076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:44.473189 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:44.484301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:44.485937 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:44.487693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:44.488587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:44.576804 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:44.592174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-85d88c4c-d484-4645-aa23-5c03f11f480a tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.437077 Oct 03 13:31:44.593279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 69/144] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:44 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:44.708776 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:44.717691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-82451145-8f65-4f8e-bcb9-4237eafec11c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.270236 Oct 03 13:31:44.718427 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 76/145] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:44 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:45.277808 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:45.282455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:45.291394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:45.292330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:45.292932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:45.295181 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:45.295779 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:45.296169 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:45.587757 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:45.602525 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cf1518d1-c92a-4077-a318-ba10526624bb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.339772 Oct 03 13:31:45.603264 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 70/146] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:45 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:45.620325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:45.621433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:45.646979 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:45.648171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:45.652429 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:45.654668 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:45.659308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:45.661293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:45.749211 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:45.755330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:45.774724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:45.798684 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:45.799529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:45.800773 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:45.813065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:45.813930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:45.868151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:45.890748 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bfa28830-f75b-4b7b-9de1-9b80cc8747e8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1315 microversion: 2.1 time: 0.276599 Oct 03 13:31:45.914929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 77/147] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:45 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:46.165198 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:46.183560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-21011c6b-d9fa-481d-9d51-ff7230a9ce06 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1367 microversion: 2.1 time: 0.444110 Oct 03 13:31:46.185778 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 71/148] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:45 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:46.355227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-c20a2452-14d2-464a-98de-a73f1dc952b3 req-ec94a9f4-d463-4ad7-8a37-21ad79bfaf7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46d2be3-6cca-411b-8b83-b13d51f53463", "name": "network-vif-plugged", "status": "completed", "tag": "9b784b63-7dc9-4c53-835b-6c3039d2f205"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:46.377300 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-c20a2452-14d2-464a-98de-a73f1dc952b3 req-ec94a9f4-d463-4ad7-8a37-21ad79bfaf7b service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:46.378556 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-c20a2452-14d2-464a-98de-a73f1dc952b3 req-ec94a9f4-d463-4ad7-8a37-21ad79bfaf7b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:46.379758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-c20a2452-14d2-464a-98de-a73f1dc952b3 req-ec94a9f4-d463-4ad7-8a37-21ad79bfaf7b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:46.399288 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-c20a2452-14d2-464a-98de-a73f1dc952b3 req-ec94a9f4-d463-4ad7-8a37-21ad79bfaf7b service nova] Creating event network-vif-plugged:9b784b63-7dc9-4c53-835b-6c3039d2f205 for instance f46d2be3-6cca-411b-8b83-b13d51f53463 on hv-cinder-86009 Oct 03 13:31:46.409077 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-c20a2452-14d2-464a-98de-a73f1dc952b3 req-ec94a9f4-d463-4ad7-8a37-21ad79bfaf7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076633 Oct 03 13:31:46.410219 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 78/149] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:31:46.659307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:46.661883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:46.678519 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:46.679339 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:46.680115 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:46.681579 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:46.682676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:46.683729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:46.946587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:46.947729 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:46.961821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:46.968322 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:46.968982 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:46.974032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:46.976259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:46.976724 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:47.040664 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:47.052232 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d01eab26-0017-4267-8151-9d9ecc29ec50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.399654 Oct 03 13:31:47.053564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 72/150] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:46 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:47.214174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:47.214174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:47.224315 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:47.224923 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:47.225244 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:47.225996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:47.239818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:47.240270 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:47.381908 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:47.393940 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1f1d3eb8-52a3-40b4-a435-2d8b66e48358 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1503 microversion: 2.1 time: 0.452197 Oct 03 13:31:47.417742 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 79/151] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:46 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1503 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:47.622491 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:47.634934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d6881d0a-fe74-495f-8512-c514c60f9ced tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1557 microversion: 2.1 time: 0.430314 Oct 03 13:31:47.646538 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 73/152] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:47 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1557 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:31:47.674086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:47.674863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:47.690682 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:47.692191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:47.693222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:47.694550 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:47.695401 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:47.696162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:47.985107 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4a746077-ed5d-40e8-b75d-a73f46450fa4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.325788 Oct 03 13:31:47.986590 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 80/153] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 3 13:31:47 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-interface => generated 285 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:31:48.084199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:48.084948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:48.097336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:48.099681 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:48.100541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:48.103708 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:48.105168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:48.105646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:48.133600 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=100 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:48.755690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:48.785723 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e2a1d2ce-ae28-4ca8-97c2-cb44b14b87a6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.706869 Oct 03 13:31:48.789847 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 74/154] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:48 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:49.827282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:49.828295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:49.830855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=70 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:49.837912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:49.838408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:49.838847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:49.839550 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:49.839999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:49.841174 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:50.062506 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:50.071836 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-79936633-5170-4ffc-807f-1f0cef19f406 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.249480 Oct 03 13:31:50.072447 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 81/155] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:49 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:50.720946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-9caaac8e-a8d5-413e-a906-ceca7e918668 req-0a8fdcab-b9b6-47a9-8c4a-a02ae14eafc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a9ff191-d009-41e4-9966-44fe462252b5", "tag": "316014ae-7577-478c-97b0-af9327de5aca"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:50.745613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=68 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:50.753341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-9caaac8e-a8d5-413e-a906-ceca7e918668 req-0a8fdcab-b9b6-47a9-8c4a-a02ae14eafc0 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:50.756206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-9caaac8e-a8d5-413e-a906-ceca7e918668 req-0a8fdcab-b9b6-47a9-8c4a-a02ae14eafc0 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:50.757787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-9caaac8e-a8d5-413e-a906-ceca7e918668 req-0a8fdcab-b9b6-47a9-8c4a-a02ae14eafc0 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:50.793537 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-9caaac8e-a8d5-413e-a906-ceca7e918668 req-0a8fdcab-b9b6-47a9-8c4a-a02ae14eafc0 service nova] Creating event network-changed:316014ae-7577-478c-97b0-af9327de5aca for instance 7a9ff191-d009-41e4-9966-44fe462252b5 on hv-cinder-86009 Oct 03 13:31:50.800196 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-9caaac8e-a8d5-413e-a906-ceca7e918668 req-0a8fdcab-b9b6-47a9-8c4a-a02ae14eafc0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083040 Oct 03 13:31:50.800920 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 75/156] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:31:51.112825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:51.114595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:51.122651 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:51.123457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:51.124539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:51.125477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:51.126083 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:51.126696 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:51.317603 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:51.330033 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7564d56d-faa0-40ee-9c95-8c8860cf6226 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.221086 Oct 03 13:31:51.331221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 82/157] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:51 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:52.381889 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:52.383507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:52.397949 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:52.399234 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:52.402760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:52.404040 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:52.404658 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:52.405121 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:52.703853 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:52.718046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-099856f2-2d05-4b39-8cce-51d5edfae766 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.351615 Oct 03 13:31:52.718791 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 76/158] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:52 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:52.990244 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3b6be9b-8a6a-4a66-b5d4-d61981a4e3b2"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:53.000100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:53.038672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:53.040926 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:53.041967 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:53.047504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:53.056989 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:53.057823 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:53.064155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:31:53.681720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0c117183-aa8c-46f7-aabe-d8f33151a79f tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "POST /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696295 Oct 03 13:31:53.683307 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 83/159] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:31:52 2022] POST /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:31:53.767335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:53.768180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:53.776938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:53.778607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:53.779849 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:53.781360 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:53.782110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:53.782707 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:54.089021 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:54.112523 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-eeae8781-1bbb-42a9-9973-4d149a2c74b5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1322 microversion: 2.1 time: 0.352779 Oct 03 13:31:54.115147 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 77/160] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:53 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:55.147392 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:55.150119 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:55.159803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:55.160298 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:55.160736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:55.161479 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:55.162206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:55.162636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:55.378807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:55.391414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6d96768d-b85b-4990-a558-a53620139726 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1516 microversion: 2.1 time: 0.251107 Oct 03 13:31:55.406225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 84/161] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:55 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:55.448197 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:31:55.453436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:55.466975 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:55.468379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:55.469537 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:55.471292 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:55.472373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:55.473406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:55.614589 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lazy-loading 'flavor' on Instance uuid f46d2be3-6cca-411b-8b83-b13d51f53463 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:31:55.822156 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-48365563-6565-41fa-a0ab-12cd76a525da tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463/action" status: 200 len: 32 microversion: 2.1 time: 0.382071 Oct 03 13:31:55.823998 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 78/162] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:31:55 2022] POST /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 13:31:55.838380 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:55.839160 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:55.862884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:55.863677 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:55.864426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:55.866222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:55.867128 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:55.868153 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:56.069010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:56.085293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9d80552d-67bc-4a6b-ad99-de3162000ee5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.251299 Oct 03 13:31:56.086532 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 85/163] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:55 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:57.133850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:57.135955 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:57.153434 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:57.157034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:57.160487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:57.162914 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:57.163852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:57.164743 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:57.434447 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:57.446010 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-aac1c4b8-4bc8-418c-b940-0d5f4e7d91d5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.333115 Oct 03 13:31:57.446926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 79/164] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:57 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:31:58.496418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:31:58.507090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:31:58.521731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:58.524683 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:58.525242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:58.529787 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:31:58.530614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:31:58.531347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:31:58.983349 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:31:59.000021 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-091cf740-841f-4f45-9af3-d47d42956734 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.509323 Oct 03 13:31:59.002106 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 86/165] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:31:58 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:00.029076 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:00.031744 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:00.040131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:00.040969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:00.042007 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:00.043405 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:00.045692 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:00.046427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:00.587301 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:00.608498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b721e537-6b9d-4e0e-af46-4b71d8fa7e18 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.585076 Oct 03 13:32:00.613150 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 80/166] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:00 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:01.641827 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:01.643831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:01.658973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:01.660268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:01.661301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:01.663255 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:01.664346 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:01.665502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:02.105068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:02.127551 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5b50ff15-25a1-4d40-9c1e-f16f95ab6ebe tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.488088 Oct 03 13:32:02.140376 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 87/167] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:01 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:03.159066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:03.161564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:03.174117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:03.175938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:03.177106 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:03.178964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:03.179774 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:03.180314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:03.542544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:03.569357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f2992f01-8151-40de-93c2-1647e064a399 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.420444 Oct 03 13:32:03.573957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 81/168] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:03 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:04.596897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:04.597543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:04.609992 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:04.610893 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:04.617557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:04.618669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:04.619547 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:04.624476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:04.865185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:04.889359 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-68c759c7-ac9d-4a1b-97f7-1effce2dc6fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.296773 Oct 03 13:32:04.891309 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 88/169] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:04 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:05.451888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:05.453825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:05.462163 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:05.462995 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:05.463822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:05.464686 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:05.466220 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:05.467028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:05.503293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:32:05.731493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e27d81ca-c15d-49b0-9ed8-a4560c6a88b8 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "DELETE /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 204 len: 0 microversion: 2.1 time: 0.283351 Oct 03 13:32:05.733147 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 82/170] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:32:05 2022] DELETE /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 13:32:05.749206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:05.751265 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:05.765877 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:05.767162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:05.768125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:05.769711 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:05.770909 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:05.772188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:05.917942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:05.920056 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:05.931450 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:05.933070 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:05.934690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:05.936358 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:05.937052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:05.937732 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:05.995727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:06.008828 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f1f2e790-a2dc-4126-a4a3-8955a280da3d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1555 microversion: 2.1 time: 0.269851 Oct 03 13:32:06.023532 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 89/171] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:05 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:06.158712 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:06.173812 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8aa2261b-f442-46fc-9fb6-fe2b76e1a792 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.259441 Oct 03 13:32:06.182536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 83/172] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:05 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:07.032690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:07.033338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:07.041018 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:07.041670 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:07.042145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:07.042839 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:07.043750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:07.044182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:07.192315 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:07.200740 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:07.202406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:07.203256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0349a98d-f5f3-47a0-a5dc-27cff2084190 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1555 microversion: 2.1 time: 0.174439 Oct 03 13:32:07.218067 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 90/173] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:07 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:07.224437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:07.225090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:07.225717 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:07.226539 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:07.227117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:07.227773 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:07.412313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:07.421609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-55e9cd7b-f359-4b2e-ab09-84dacebcd0f9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.225798 Oct 03 13:32:07.438941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 84/174] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:07 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:08.234414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:08.237028 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:08.251353 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:08.253403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:08.254686 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:08.256335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:08.257717 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:08.260000 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:08.459308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:08.462361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:08.477493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:08.479053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:08.480191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:08.483162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:08.484831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:08.487055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:08.667677 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:08.677010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-43ea47e8-c1d8-4b64-a896-9002d34ff8e9 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1555 microversion: 2.1 time: 0.451196 Oct 03 13:32:08.690251 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 91/175] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:08 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1555 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:08.812960 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:08.825060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b2f9bc67-82e2-49e4-86ec-361285c8bcef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.376500 Oct 03 13:32:08.836874 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 85/176] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:08 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:09.729219 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:09.730091 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:09.738352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:09.739362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:09.739925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:09.740722 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:09.741245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:09.741924 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:09.869338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:09.878224 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:09.893098 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:09.894504 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:09.895608 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:09.897225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:09.898446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:09.899867 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:09.972456 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:09.989373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dfe1dc12-aaab-4086-a7a7-d1b49d92743c tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1555 microversion: 2.1 time: 0.264984 Oct 03 13:32:09.990088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 92/177] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:09 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1555 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:10.149792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:10.160102 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-eb85ceab-dedc-48ed-a896-14c34ce386be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.305383 Oct 03 13:32:10.160796 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 86/178] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:09 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:11.020407 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:11.021884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:11.031413 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:11.032326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:11.033385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:11.036667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:11.036667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:11.036667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:11.196607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:11.199761 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:11.218751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:11.220266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:11.222432 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:11.224064 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:11.226162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:11.227510 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:11.307764 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:11.321175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-757287aa-3189-4939-8bda-0c583cc742e4 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1555 microversion: 2.1 time: 0.305613 Oct 03 13:32:11.323209 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 93/179] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:11 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1555 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:11.543854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:11.563272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3a0ccbb7-8b21-4fbf-ba8c-cbf46758246c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.374941 Oct 03 13:32:11.564853 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 87/180] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:11 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:12.374889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:12.383745 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:12.404689 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:12.405603 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:12.406370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:12.410439 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:12.411280 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:12.412052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:12.589884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:12.592323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:12.607967 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:12.609005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:12.609538 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:12.611977 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:12.612518 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:12.612963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:12.665294 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:12.741296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:12.760101 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ebc5bb9d-2e63-4fe1-bc55-28967c97fe2d tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1555 microversion: 2.1 time: 0.398749 Oct 03 13:32:12.776978 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 94/181] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:12 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1555 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:12.935297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:12.971858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3b462b12-0d76-4871-b84d-ab169de44aaf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.386019 Oct 03 13:32:12.997506 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 88/182] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:12 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:13.163185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-97373981-7232-46fe-92e0-a081fc07c94f req-16dfceec-37d9-4239-b6f2-64c26b65eb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81de33cc-ab4f-402c-bc77-a8818e85ad75", "name": "network-vif-deleted", "tag": "a1d48bcc-c2cd-4550-b46c-0b4470912f16"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:32:13.180869 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-97373981-7232-46fe-92e0-a081fc07c94f req-16dfceec-37d9-4239-b6f2-64c26b65eb2f service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:13.181557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-97373981-7232-46fe-92e0-a081fc07c94f req-16dfceec-37d9-4239-b6f2-64c26b65eb2f service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:13.182116 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-97373981-7232-46fe-92e0-a081fc07c94f req-16dfceec-37d9-4239-b6f2-64c26b65eb2f service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:13.216323 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-97373981-7232-46fe-92e0-a081fc07c94f req-16dfceec-37d9-4239-b6f2-64c26b65eb2f service nova] Creating event network-vif-deleted:a1d48bcc-c2cd-4550-b46c-0b4470912f16 for instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 on hv-cinder-86009 Oct 03 13:32:13.224866 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-97373981-7232-46fe-92e0-a081fc07c94f req-16dfceec-37d9-4239-b6f2-64c26b65eb2f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064909 Oct 03 13:32:13.227541 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 95/183] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:32:13.785758 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:13.786384 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:13.796644 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:13.797575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:13.798359 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:13.799238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:13.800036 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:13.800620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:13.891672 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:13.892558 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:13.893581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:13.894828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lazy-loading 'fault' on Instance uuid 81de33cc-ab4f-402c-bc77-a8818e85ad75 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:32:13.986348 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:14.001004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-71b68202-e52a-4637-b80d-f08cdae83526 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1351 microversion: 2.1 time: 0.220146 Oct 03 13:32:14.012199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 89/184] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:13 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1351 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:14.046449 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:14.048073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:14.060518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:14.062542 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:14.063463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:14.064881 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:14.065931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:14.067449 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:14.320381 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:14.345384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-21498fb6-3753-4c5f-bd06-ff303fa4fb51 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.311973 Oct 03 13:32:14.345927 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 96/185] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:14 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:15.029289 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:15.030300 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:15.037023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:15.037574 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:15.038366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:15.039667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:15.040423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:15.040941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:15.083336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:15.083827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:15.084261 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:15.084959 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lazy-loading 'fault' on Instance uuid 81de33cc-ab4f-402c-bc77-a8818e85ad75 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:32:15.147931 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:15.157756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-74a32473-eca9-4bb5-b797-c8daa2018db7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1351 microversion: 2.1 time: 0.134434 Oct 03 13:32:15.158331 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 90/186] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:15 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:15.374756 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:15.375499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:15.383094 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:15.383646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:15.384162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:15.384872 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:15.385325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:15.385794 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:15.554691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:15.568707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d24904fc-d832-4ac3-905d-d6d10b5c5d90 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.198627 Oct 03 13:32:15.569540 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 97/187] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:15 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:16.195990 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:16.196678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:16.204419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:16.205010 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:16.205356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:16.206096 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:16.206551 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:16.206977 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:16.243542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:16.244036 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:16.244476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:16.244932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lazy-loading 'fault' on Instance uuid 81de33cc-ab4f-402c-bc77-a8818e85ad75 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:32:16.303778 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:16.315915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d04a2f95-9583-43a2-86eb-56d4bce77270 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1351 microversion: 2.1 time: 0.123707 Oct 03 13:32:16.316636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 91/188] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:16 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:16.598188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:16.599350 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:16.611687 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:16.612565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:16.613352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:16.614648 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:16.615503 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:16.616289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:16.804217 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:16.813306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-168213bc-6581-491e-87fc-aad8ba99e9ba tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.223675 Oct 03 13:32:16.813833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 98/189] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:16 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:17.343277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:17.343911 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:17.350859 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:17.351495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:17.351987 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:17.352925 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:17.353393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:17.353958 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:17.414125 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:17.414816 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:17.415668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:17.416459 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lazy-loading 'fault' on Instance uuid 81de33cc-ab4f-402c-bc77-a8818e85ad75 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:32:17.470179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8defdf430274affaed766d8aedccfad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f908aee304e4fe2bb2185d89400533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:17.479287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-43d8e62b-f3bd-4c6f-9559-5ea08af61ee7 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 200 len: 1351 microversion: 2.1 time: 0.140496 Oct 03 13:32:17.479886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 92/190] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:17 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 1351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:17.842412 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:17.843530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:17.853104 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:17.853772 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:17.854307 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:17.855205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:17.855850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:17.856351 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:17.859802 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:18.040487 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:18.053836 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-466235bd-2743-4ee8-833b-7351f48e4ff8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.218224 Oct 03 13:32:18.054686 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 99/191] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:17 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:18.524613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:18.526072 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:18.537537 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:18.538397 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:18.539224 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:18.540699 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:18.541619 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:18.542494 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:18.571432 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] HTTP exception thrown: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Request method failure captured: Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 HTTP/1.1 Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQGQJ1E48wl8ZRpW8cSZwtbZxjm5FfNCDaWAtA_syj-Wz6QchDRQtVwPGXU6dAJFwr5N3WwZyK2EEy0L8VWVvI6Os_b_Jd_3Xa7ddzqK8wm0KfZkSl6BSizh7xqDs9yjPSA3MqW5uAIpsNdDr4pPLcRHu2oyx1XUhIpKWKoCt3GDi0 Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 5f908aee304e4fe2bb2185d89400533c Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:32:18.593819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 5f908aee304e4fe2bb2185d89400533c Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-DeleteServersTestJSON-2036391304-project Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: b8defdf430274affaed766d8aedccfad Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-DeleteServersTestJSON-2036391304-project Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.596625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '81de33cc-ab4f-402c-bc77-a8818e85ad75'} Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:32:18.599039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.603219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.606495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Returning 404 to user: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:32:18.606495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5e72588d-b4e0-4cdf-a87d-2cb8a3784392 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 404 len: 111 microversion: 2.1 time: 0.072284 Oct 03 13:32:18.606495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 93/192] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:18 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:32:18.803406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:18.806116 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:18.814929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:18.819140 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:18.820120 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:18.821363 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:18.822069 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:18.822708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:18.849177 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] HTTP exception thrown: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Request method failure captured: Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75/os-volume_attachments HTTP/1.1 Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQGQJ1E48wl8ZRpW8cSZwtbZxjm5FfNCDaWAtA_syj-Wz6QchDRQtVwPGXU6dAJFwr5N3WwZyK2EEy0L8VWVvI6Os_b_Jd_3Xa7ddzqK8wm0KfZkSl6BSizh7xqDs9yjPSA3MqW5uAIpsNdDr4pPLcRHu2oyx1XUhIpKWKoCt3GDi0 Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 5f908aee304e4fe2bb2185d89400533c Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:32:18.857667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 5f908aee304e4fe2bb2185d89400533c Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-DeleteServersTestJSON-2036391304-project Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: b8defdf430274affaed766d8aedccfad Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-DeleteServersTestJSON-2036391304-project Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.860400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'server_id': '81de33cc-ab4f-402c-bc77-a8818e85ad75'} Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:32:18.862643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:18.865928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:18.868884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Returning 404 to user: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:32:18.868884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5c4b8cc0-955e-4e5d-837a-37791f451874 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060770 Oct 03 13:32:18.868884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 100/193] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:32:18 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:32:19.103123 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:19.107168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:19.119471 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:19.121273 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:19.122256 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:19.123667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:19.124672 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:19.125504 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:19.319579 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:19.337370 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c2cddf8f-7372-434c-a693-20944f90d89d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.242589 Oct 03 13:32:19.338507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 94/194] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:19 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:20.384101 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:20.384101 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:20.393513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=40 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:20.396424 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:20.397681 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:20.398503 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:20.399938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:20.400884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:20.402707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:20.748918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:20.764011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c48521e3-aec2-47db-89f3-3a2f6a3cd50d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.388063 Oct 03 13:32:20.765063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 101/195] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:20 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:21.791216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:21.791892 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:21.794997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:21.810225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:21.810993 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:21.811741 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:21.813000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:21.813995 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:21.815189 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:22.002427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:22.021121 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b089860c-f51c-4c14-a1a4-8a49515500c8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.234283 Oct 03 13:32:22.025858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 95/196] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:21 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:23.053021 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:23.054486 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:23.065750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:23.066776 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:23.067530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:23.068687 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:23.069595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:23.070382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:23.487122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:23.495617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c73d611a-94cb-4af8-93fb-51101acc42ec tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.452084 Oct 03 13:32:23.496607 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 102/197] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:23 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:23.529524 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:23.530603 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:23.537496 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:23.538161 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:23.538687 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:23.539602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:23.540138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:23.540708 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:23.565222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] HTTP exception thrown: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Request method failure captured: Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 HTTP/1.1 Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQGQJ1E48wl8ZRpW8cSZwtbZxjm5FfNCDaWAtA_syj-Wz6QchDRQtVwPGXU6dAJFwr5N3WwZyK2EEy0L8VWVvI6Os_b_Jd_3Xa7ddzqK8wm0KfZkSl6BSizh7xqDs9yjPSA3MqW5uAIpsNdDr4pPLcRHu2oyx1XUhIpKWKoCt3GDi0 Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 5f908aee304e4fe2bb2185d89400533c Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:32:23.566915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 5f908aee304e4fe2bb2185d89400533c Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-DeleteServersTestJSON-2036391304-project Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: b8defdf430274affaed766d8aedccfad Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-DeleteServersTestJSON-2036391304-project Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.568330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '81de33cc-ab4f-402c-bc77-a8818e85ad75'} Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:32:23.569112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.570818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.572279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Returning 404 to user: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:32:23.572279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9992d91c-0c73-4a32-9fdb-7980bd214da3 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "DELETE /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 404 len: 111 microversion: 2.1 time: 0.045632 Oct 03 13:32:23.572920 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 96/198] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:32:23 2022] DELETE /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:32:23.583111 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:23.583784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] [instance: 81de33cc-ab4f-402c-bc77-a8818e85ad75] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:23.591101 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:23.591840 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:23.592273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:23.592976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:23.593487 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:23.593931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:23.618595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] HTTP exception thrown: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Request method failure captured: Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 HTTP/1.1 Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQGQJ1E48wl8ZRpW8cSZwtbZxjm5FfNCDaWAtA_syj-Wz6QchDRQtVwPGXU6dAJFwr5N3WwZyK2EEy0L8VWVvI6Os_b_Jd_3Xa7ddzqK8wm0KfZkSl6BSizh7xqDs9yjPSA3MqW5uAIpsNdDr4pPLcRHu2oyx1XUhIpKWKoCt3GDi0 Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 5f908aee304e4fe2bb2185d89400533c Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:32:23.623297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f908aee304e4fe2bb2185d89400533c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 5f908aee304e4fe2bb2185d89400533c Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-DeleteServersTestJSON-2036391304 Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-DeleteServersTestJSON-2036391304-project Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: b8defdf430274affaed766d8aedccfad Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-DeleteServersTestJSON-2036391304-project Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.626019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '81de33cc-ab4f-402c-bc77-a8818e85ad75'} Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:32:23.627483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. Oct 03 13:32:23.630361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:32:23.633666 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] Returning 404 to user: Instance 81de33cc-ab4f-402c-bc77-a8818e85ad75 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:32:23.634727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-caebd555-226f-44e2-b816-efc7dca08b70 tempest-DeleteServersTestJSON-2036391304 tempest-DeleteServersTestJSON-2036391304-project] 10.222.0.58 "GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75" status: 404 len: 111 microversion: 2.1 time: 0.055475 Oct 03 13:32:23.635533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 103/199] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:23 2022] GET /compute/v2.1/servers/81de33cc-ab4f-402c-bc77-a8818e85ad75 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:32:24.530123 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:24.532338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:24.544669 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:24.546854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:24.548438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:24.550675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:24.551989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:24.553019 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:25.050132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:25.068701 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9223e145-a80c-4530-aaec-aed15682089e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.547236 Oct 03 13:32:25.070700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 97/200] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:24 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:26.107725 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:26.110849 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:26.143668 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:26.146353 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:26.150373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:26.155529 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:26.159734 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:26.161354 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:26.502222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:26.524935 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-637f96a7-908c-42c9-8fc2-b4c31d68fe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.425024 Oct 03 13:32:26.525553 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 104/201] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:26 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:27.560341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:27.563668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:27.581411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:27.586781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:27.587663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:27.591120 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:27.592727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:27.593916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:27.869478 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:27.879629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-dc77eb3a-4356-4464-9e59-5f2d1cbc3e94 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.330692 Oct 03 13:32:27.880557 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 98/202] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:27 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:28.922867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:28.923646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:28.951845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:28.952925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:28.953594 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:28.954693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:28.956782 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:28.957558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:29.215043 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:29.223933 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-88dee4a0-4e8e-4f6c-8d8e-d983cc0fd3bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.306734 Oct 03 13:32:29.225971 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 105/203] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:28 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:30.251057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:30.251858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:30.266500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:30.267442 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:30.268981 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:30.270003 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:30.271320 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:30.272128 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:30.544807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:30.553511 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ae0ab391-06eb-48f3-b7eb-7d3de414950e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.307862 Oct 03 13:32:30.554105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 99/204] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:30 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:31.581174 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:31.592480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:31.617403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:31.621790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:31.622799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:31.624162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:31.625053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:31.626314 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:31.907809 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:31.923975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5230b3f1-a56a-4004-81af-de49fda41706 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.350072 Oct 03 13:32:31.925380 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 106/205] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:31 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:32.955154 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:32.957997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:32.974937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:32.976060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:32.977132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:32.981073 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:32.983332 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:32.983855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:33.206801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:33.211130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-61cf8c7b-8b3e-4e41-995e-c094a7be7ded tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.263847 Oct 03 13:32:33.211777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 100/206] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:32 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:34.238980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:34.242693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:34.270939 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:34.270939 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:34.270939 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:34.273752 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:34.278124 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:34.278421 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:34.650646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:34.661195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5e6cb27d-e9c2-44c8-b823-194b360bb77f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.426849 Oct 03 13:32:34.675723 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 107/207] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:34 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:35.718805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:35.720107 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:35.729837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:35.730724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:35.731337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:35.732386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:35.733011 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:35.733636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:36.232864 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:36.246940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-52306ed2-74ac-416e-83a1-47806720904e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.532745 Oct 03 13:32:36.248573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 101/208] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:35 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:37.274169 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:37.274732 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:37.282502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:37.282987 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:37.290227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:37.291724 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:37.292682 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:37.293297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:37.660810 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:37.680722 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-627c1e20-8490-410d-ad45-db074b5c2ff3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.410557 Oct 03 13:32:37.693615 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 108/209] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:37 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:38.720964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:38.722238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:38.731930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:38.735263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:38.751024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:38.752916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:38.753716 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:38.755700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:39.025771 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:39.044082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-07b75900-6fd0-435c-9321-df82aedf6141 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.326002 Oct 03 13:32:39.044790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 102/210] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:38 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:40.092762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:40.093939 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:40.116092 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:40.119228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:40.125189 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:40.129648 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:40.130719 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:40.131573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:40.544915 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:40.563750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-039b4e76-25a0-48f0-9c14-b532b2be5670 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.474525 Oct 03 13:32:40.564790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 109/211] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:40 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:41.053245 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9504eb50-7c0c-4426-8732-59b36b008c63 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'create', calling method: .version_select at 0x7f7c21d2ca60>, body: {"keypair": {"name": "tempest-keypair-1051871299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqBiNsCW6wHl+eKyrjhKgAWKtkPwjKAbpkRt+HRTUX0tyjBkg09SKSoMEs56fEmBXVbr7Vki5cl8R82Z+MrkYmoI7V4JsIQikI5CmvtQgA1LGoLG9T751eignatxY+OZA=="}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:32:41.080832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-9504eb50-7c0c-4426-8732-59b36b008c63 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Getting quotas for project 1432ad4a21624574b8caeaf10f2f8339. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:32:41.086248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-9504eb50-7c0c-4426-8732-59b36b008c63 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Getting quotas for user 4471a60040ca42649f2718fd46659e31 and project 1432ad4a21624574b8caeaf10f2f8339. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:32:41.119597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9504eb50-7c0c-4426-8732-59b36b008c63 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.300199 Oct 03 13:32:41.140951 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 103/212] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:32:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:32:41.600979 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:41.602487 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:41.615686 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:41.616669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:41.617624 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:41.619078 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:41.620562 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:41.621497 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:41.942210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:41.954158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cf503531-88f1-4c6d-872d-90df6984746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.360730 Oct 03 13:32:41.962498 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 110/213] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:41 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:42.990858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:42.994390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:43.005828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:43.006971 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:43.007904 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:43.009165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:43.010261 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:43.011306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:43.019662 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=90 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:43.090209 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-550083787", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ae25b55-bed6-49d7-9a22-c9e416e149dd"}], "security_groups": [{"name": "tempest-securitygroup--1699600443"}], "key_name": "tempest-keypair-1051871299", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:32:43.240463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] validate_networks() for [('4ae25b55-bed6-49d7-9a22-c9e416e149dd', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:32:43.274408 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:43.288969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ac132f8e-ce09-487f-ba5a-8685ed8e6fcb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.312795 Oct 03 13:32:43.294245 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 104/214] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:42 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:44.050746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:32:44.051418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:32:44.052331 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:32:44.053341 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:32:44.054252 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:32:44.074333 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:44.075368 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:44.076415 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:44.077896 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:44.079048 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:44.080011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:44.128151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Getting quotas for project 1432ad4a21624574b8caeaf10f2f8339. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:32:44.138558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Getting quotas for user 4471a60040ca42649f2718fd46659e31 and project 1432ad4a21624574b8caeaf10f2f8339. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:32:44.177732 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:32:44.182878 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:32:44.322980 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:44.330300 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:44.368305 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f57cb00f-29b7-4e88-851f-6fa198d43bbb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.284829 Oct 03 13:32:44.373647 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 111/215] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:32:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:32:44.386682 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:44.387425 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:44.388098 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:44.389092 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:44.395358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9555241c-ec1e-41c8-95fa-dca0f2626bf5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:44.396663 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9555241c-ec1e-41c8-95fa-dca0f2626bf5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:44.401715 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:44.403114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:44.624408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9555241c-ec1e-41c8-95fa-dca0f2626bf5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:44.644436 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9555241c-ec1e-41c8-95fa-dca0f2626bf5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1237 microversion: 2.1 time: 0.260471 Oct 03 13:32:44.645535 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 112/216] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:44 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1237 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:44.662052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1992032139", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "networks": [{"uuid": "eaea14e2-06e5-440b-8c67-d4a587c52b53"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:32:44.816214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] validate_networks() for [('eaea14e2-06e5-440b-8c67-d4a587c52b53', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:32:44.889734 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:44.962204 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1088abf7-2196-4589-a89e-647ebea4c20e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.646424 Oct 03 13:32:44.970850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 105/217] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:44 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:45.673615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:45.674765 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:45.694595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:45.695435 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:45.696158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:45.697339 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:45.702156 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:45.704920 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:45.787228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:32:45.788285 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:32:45.789440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:32:45.790300 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:32:45.797503 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:32:45.840260 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:45.841796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:45.842863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:45.844548 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:45.845552 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:45.846680 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:45.893174 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Getting quotas for project afa1958afb874a0cba4c57df10f2ce08. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:32:45.903904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Getting quotas for user 9b293568e74c4c69baee5cb29013ab6d and project afa1958afb874a0cba4c57df10f2ce08. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:32:45.934129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:32:45.939437 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:32:46.035802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:46.049899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e9cc835b-a0f1-48df-9e0e-26f38f38e5a5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1241 microversion: 2.1 time: 0.385158 Oct 03 13:32:46.058253 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 106/218] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:45 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1241 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:46.082804 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:46.083422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:46.089825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6b389f2f-e522-4f92-ade4-9beefe46f7a6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426167 Oct 03 13:32:46.098458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 113/219] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:32:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:32:46.138606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-86ee3a0b-3282-4418-a053-96dbdd21df1e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:46.138886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:46.140034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:46.145339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-86ee3a0b-3282-4418-a053-96dbdd21df1e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:46.154043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:46.156050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:46.157190 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:46.158358 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:46.334932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-86ee3a0b-3282-4418-a053-96dbdd21df1e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:46.353557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-86ee3a0b-3282-4418-a053-96dbdd21df1e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1214 microversion: 2.1 time: 0.245748 Oct 03 13:32:46.355630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 114/220] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:46 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1214 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:46.504598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:46.515882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-44212e3e-5389-435b-802a-9203b4713ef7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.455578 Oct 03 13:32:46.516877 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 107/221] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:46 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:47.099351 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:47.100180 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:47.108727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:47.109760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:47.110207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:47.110943 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:47.111414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:47.111835 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:47.202643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:47.212616 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c8784104-36ad-4929-b271-4e16b4d29598 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1241 microversion: 2.1 time: 0.119304 Oct 03 13:32:47.213841 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 115/222] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:47 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:47.393934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:47.395016 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:47.414014 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:47.418042 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:47.418042 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:47.418042 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:47.418042 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:47.424260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:47.532520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:47.543001 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9cc0a9d5-d171-4e88-872d-b9a8ddea5d83 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1218 microversion: 2.1 time: 0.155589 Oct 03 13:32:47.550142 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 108/223] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:47 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:47.557195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:47.558334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:47.573493 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:47.574395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:47.575019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:47.577278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:47.577984 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:47.578439 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:47.777268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:47.798826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-97524117-6f02-4401-95f7-13aed1b9241b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.244986 Oct 03 13:32:47.800848 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 116/224] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:47 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:48.243955 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:48.245232 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:48.256781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:48.257608 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:48.258102 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:48.259240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:48.260057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:48.261239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:48.457426 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:48.471389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6dab54ca-cae7-40d2-8507-aad986ce5f78 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1289 microversion: 2.1 time: 0.235790 Oct 03 13:32:48.473666 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 109/225] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:48 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1289 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:48.593316 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:48.611139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:48.640404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:48.641043 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:48.641951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:48.642948 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:48.644201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:48.644629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:48.649828 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=80 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:48.821267 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:48.836728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:48.837609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:48.839715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-467ab805-7cee-4e22-82aa-223270e85eef tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1210 microversion: 2.1 time: 0.256989 Oct 03 13:32:48.842324 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 117/226] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:48 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1210 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:48.851013 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:48.852276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:48.853329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:48.854739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:48.855706 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:48.856476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:49.102586 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:49.112594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-af6a2c5d-dfc2-42a4-927b-c274e1776dcc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.282799 Oct 03 13:32:49.113902 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 110/227] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:48 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:49.531790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:49.537016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:49.549646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:49.550196 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:49.550707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:49.551807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:49.552355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:49.552790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:49.635578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:49.658512 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3b35b9f7-c038-4f62-87f9-bbbcefa8419d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1289 microversion: 2.1 time: 0.134112 Oct 03 13:32:49.663240 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 118/228] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:49 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:49.867980 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:49.869280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:49.881317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:49.885747 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:49.886490 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:49.890676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:49.891222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:49.891739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:50.017601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:50.035463 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-31477f10-ac4f-430a-a53e-59654d9e58d3 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1210 microversion: 2.1 time: 0.171436 Oct 03 13:32:50.042031 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 111/229] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:49 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1210 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:50.142363 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:50.143101 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:50.152920 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:50.153690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:50.154324 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:50.155043 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:50.155522 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:50.156960 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:50.690796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:50.697062 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:50.698793 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:50.706053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0a7dfc6c-caba-4eb0-a865-18c97b1e0426 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.568526 Oct 03 13:32:50.716490 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:50.717279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:50.718040 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:50.719077 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:50.719703 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:50.720293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:50.721894 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 119/230] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:50 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:50.801387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:50.813341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f526852a-4e4a-40e9-89ae-a9ee2d9a9b3d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1295 microversion: 2.1 time: 0.128384 Oct 03 13:32:50.814698 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 112/231] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:50 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1295 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:51.065916 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:51.067508 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:51.071289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:51.098179 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:51.098800 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:51.099235 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:51.099976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:51.100448 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:51.100869 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:51.208863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:51.221521 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3d1d3e17-a571-4c91-938b-933c6cba87eb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1266 microversion: 2.1 time: 0.162352 Oct 03 13:32:51.223738 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 120/232] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:51 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:51.259376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1208727333", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "networks": [{"uuid": "e099c20e-064c-44a9-b92e-4dc5aecf03f8"}]}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:32:51.272325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:51.331560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] validate_networks() for [('e099c20e-064c-44a9-b92e-4dc5aecf03f8', None, None, None, None, None)] {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:32:51.738483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:51.740426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:51.754851 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:51.755938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:51.756938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:51.763099 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:51.764375 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:51.765246 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:51.983875 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:32:51.985039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:32:51.986541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:32:51.987549 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:32:51.990122 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:32:52.019542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:52.034692 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:52.044355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:52.045670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:52.047441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:52.055797 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:52.057487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:52.110070 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Getting quotas for project 33af9400d270489da18c21dee3f9188f. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:32:52.118850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Getting quotas for user 75e5a47c5b314a0486d3a32ffbead793 and project 33af9400d270489da18c21dee3f9188f. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:32:52.153950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:32:52.159149 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:32:52.168175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:52.201850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-87e29b76-6213-43d9-97fc-21a22895ef15 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1522 microversion: 2.1 time: 0.473143 Oct 03 13:32:52.218530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 121/233] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:51 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:52.263405 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:52.264652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:52.278063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:52.279092 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:52.280322 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:52.281941 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:52.284123 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:52.286021 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:52.293849 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-dd36536a-d9dd-4505-b89f-9231a961e8a3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038544 Oct 03 13:32:52.299026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 113/234] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:32:52.309981 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:52.315675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:52.331662 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:52.332519 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:52.333170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:52.334157 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:52.334845 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:52.335808 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:52.417942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:52.427696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-073f7727-cf21-4842-b55d-cf01af3605a5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1274 microversion: 2.1 time: 0.126489 Oct 03 13:32:52.428572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 114/235] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:52 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:52.437554 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4ddc09e0-d75d-4859-ad26-828835b9cd1f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:52.438509 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4ddc09e0-d75d-4859-ad26-828835b9cd1f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:52.541471 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4ddc09e0-d75d-4859-ad26-828835b9cd1f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:52.554492 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4ddc09e0-d75d-4859-ad26-828835b9cd1f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1219 microversion: 2.1 time: 0.124601 Oct 03 13:32:52.555541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 115/236] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:52 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:52.805534 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:52.844118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4d78b27f-d2f1-40de-832e-89ebbc6a3625 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.623411 Oct 03 13:32:52.848277 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 122/237] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:52 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:53.267666 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:53.269858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:53.283889 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.285504 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.286862 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.288091 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.289262 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.290193 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.481709 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:53.485323 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:53.506246 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.507180 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.507686 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.508511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.509042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.509524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.676428 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:53.699063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-01b9315e-ef77-4431-957a-9ae1538fe280 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1272 microversion: 2.1 time: 0.220233 Oct 03 13:32:53.700381 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 123/238] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:53 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:53.705758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:53.706710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:53.721195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.722971 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.723718 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.724573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:53.726090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.730750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.733249 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.736031 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ca05172c-8c34-4657-93fc-8b881abac3be tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1502 microversion: 2.1 time: 0.478072 Oct 03 13:32:53.736650 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 116/239] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:53 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1502 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:53.745890 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-c425d5d2-e47b-45da-8170-4bf15ca347de req-fc68781e-4623-4868-a0bc-9a10355e26f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca377db-f0f6-4888-a94e-cfde65e470e9", "tag": "b7b4c568-efe4-4d19-8923-b411916ba1a1"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:32:53.779934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-c425d5d2-e47b-45da-8170-4bf15ca347de req-fc68781e-4623-4868-a0bc-9a10355e26f3 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.787681 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-c425d5d2-e47b-45da-8170-4bf15ca347de req-fc68781e-4623-4868-a0bc-9a10355e26f3 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.787986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-c425d5d2-e47b-45da-8170-4bf15ca347de req-fc68781e-4623-4868-a0bc-9a10355e26f3 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.820226 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-c425d5d2-e47b-45da-8170-4bf15ca347de req-fc68781e-4623-4868-a0bc-9a10355e26f3 service nova] Creating event network-changed:b7b4c568-efe4-4d19-8923-b411916ba1a1 for instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 on hv-cinder-86009 Oct 03 13:32:53.826601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-c425d5d2-e47b-45da-8170-4bf15ca347de req-fc68781e-4623-4868-a0bc-9a10355e26f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088659 Oct 03 13:32:53.827238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 117/240] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:32:53.832927 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:53.834662 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:53.844462 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.844961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.845407 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.846176 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:53.846647 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:53.847077 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:53.972725 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:53.985073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1a761789-14a6-43d2-b867-65414faec03f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1271 microversion: 2.1 time: 0.283165 Oct 03 13:32:53.999893 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 124/241] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:53 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:54.017912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:54.019071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:54.027061 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:54.027823 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:54.028860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:54.029823 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:54.031093 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:54.031734 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:54.083819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:54.092999 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-79458979-0c73-4223-bcd6-1a14224b3780 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1517 microversion: 2.1 time: 0.264131 Oct 03 13:32:54.094360 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 118/242] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:53 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1517 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:54.393711 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:54.407434 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4b1141cb-5a81-4824-ad87-1400d19f6e75 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.396866 Oct 03 13:32:54.424844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 125/243] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:54 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:54.730873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:54.732046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:54.743931 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:54.745705 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:54.746649 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:54.748250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:54.749545 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:54.750660 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:55.018807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:55.019571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:55.028735 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:55.029227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:55.029726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:55.030432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:55.031144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:55.031805 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:55.068757 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:55.088930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-df089860-ca44-433d-b13b-c74be9ce1338 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.365346 Oct 03 13:32:55.102652 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 119/244] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:54 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:55.146364 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:55.155387 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e3f17b50-ebfb-4fef-bc9b-52ed338c1cf0 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1279 microversion: 2.1 time: 0.143005 Oct 03 13:32:55.156141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 126/245] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:55 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:55.448464 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:55.449314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:55.456397 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:55.456996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:55.457599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:55.458426 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:55.458981 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:55.459503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:55.717153 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-a95c0851-37d5-46fe-ba86-8189c75ff843 req-2071ce57-fbfb-43fa-be9f-e0f711ce2823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd04a837-3721-447a-82af-4be3bd4a2d8b", "tag": "a26ac185-9533-4e8e-9f6b-3c2a32872f1a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:32:55.730836 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a95c0851-37d5-46fe-ba86-8189c75ff843 req-2071ce57-fbfb-43fa-be9f-e0f711ce2823 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:55.750313 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a95c0851-37d5-46fe-ba86-8189c75ff843 req-2071ce57-fbfb-43fa-be9f-e0f711ce2823 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:55.750886 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a95c0851-37d5-46fe-ba86-8189c75ff843 req-2071ce57-fbfb-43fa-be9f-e0f711ce2823 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:55.753169 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:55.765882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-a95c0851-37d5-46fe-ba86-8189c75ff843 req-2071ce57-fbfb-43fa-be9f-e0f711ce2823 service nova] Creating event network-changed:a26ac185-9533-4e8e-9f6b-3c2a32872f1a for instance bd04a837-3721-447a-82af-4be3bd4a2d8b on hv-cinder-86009 Oct 03 13:32:55.774359 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-a95c0851-37d5-46fe-ba86-8189c75ff843 req-2071ce57-fbfb-43fa-be9f-e0f711ce2823 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061218 Oct 03 13:32:55.775338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 127/246] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:32:55.782325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2f829360-2c7f-4289-8cf4-028347cf7070 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.337356 Oct 03 13:32:55.784205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 120/247] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:55 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:55.784672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:32:55.787509 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:55.803582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:55.804084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:55.804830 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:55.805598 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:55.806245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:55.806685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:55.841949 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lazy-loading 'flavor' on Instance uuid 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:32:55.876891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:56.023104 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8a67d690-7cf1-453e-bf66-e80bb0da36bf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8/action" status: 200 len: 32 microversion: 2.1 time: 0.245467 Oct 03 13:32:56.024666 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 128/248] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:32:55 2022] POST /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:32:56.044125 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:56.045521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:56.061179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:56.062964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:56.064148 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:56.065836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:56.068082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:56.072463 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:56.157935 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:56.159706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:56.199646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:56.200814 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:56.201746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:56.204257 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:56.218302 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:56.219909 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:56.365253 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=16 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:56.902842 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:56.992121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eb85d781-88d7-44a7-97c7-c76d50d64efd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.837683 Oct 03 13:32:56.997404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 129/249] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:56 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:57.020339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:57.021516 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:57.035025 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:57.036165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:57.036761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:57.038290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:57.039573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:57.040546 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:57.069653 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:57.082704 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-135698b4-e304-4093-b2b6-1903105b4d26 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 1.048911 Oct 03 13:32:57.086795 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 121/250] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:56 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:57.101205 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:57.102185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:57.114051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:57.115019 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:57.115475 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:57.116361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:57.116830 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:57.117599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:57.243350 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:57.259530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cf6b84bc-c21d-4aeb-95f1-0c3c9e9245bb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1277 microversion: 2.1 time: 0.260094 Oct 03 13:32:57.260355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 130/251] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:56 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:57.477110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:57.491312 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c920f490-c9f8-4c17-ab62-f6345a0fd78f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.402962 Oct 03 13:32:57.491914 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 122/252] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:57 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:58.035366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:58.036669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:58.055185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:58.066699 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:58.068253 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:58.069763 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:58.073027 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:58.074516 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:58.116027 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:58.120129 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:58.136706 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:58.139131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:58.142175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:58.145223 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:58.147755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:58.151955 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:58.163521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=100 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:58.556957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:58.568047 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d914ea33-1019-4d7d-aa35-35dc5bacf50f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.457341 Oct 03 13:32:58.574100 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 123/253] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:58 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:58.584743 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:58.585948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:58.608801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:58.609030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:58.609688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:58.611204 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:58.611979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:58.612696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:58.684397 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:58.720023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-64671f21-41f2-4b33-b772-7dc53d07a898 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.697604 Oct 03 13:32:58.721796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 131/254] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:58 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:58.733333 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:58.734375 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:58.735098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:58.746108 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:58.747313 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:58.748242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:58.749308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:58.749996 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:58.750691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:58.771164 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b43ceef0-2c98-4c7b-a14e-dc6ba4a9af10 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1277 microversion: 2.1 time: 0.194505 Oct 03 13:32:58.772778 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 124/255] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:58 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:58.786158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:32:59.121141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:59.137107 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7bcc6fce-995b-4960-b7f7-6aee75b3e187 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.412691 Oct 03 13:32:59.138258 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 132/256] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:58 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:32:59.619660 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:59.620702 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:59.630905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:59.631758 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:59.632788 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:59.634317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:59.635947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:59.636829 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:59.780586 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:59.781912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:59.821005 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:59.822868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:59.826697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:59.829314 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:59.833328 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:59.836728 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:59.942198 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:32:59.959200 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5e0ce839-2f78-4b16-bb16-38b3f21c4cef tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.346832 Oct 03 13:32:59.960783 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 125/257] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:59 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:32:59.970905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:32:59.972618 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:32:59.986581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:59.987815 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:59.988915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:32:59.990709 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:32:59.992051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:32:59.993091 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:00.189216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:00.203477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9f9ed58f-0c76-4f5e-bd04-e8b80f477725 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.240309 Oct 03 13:33:00.204530 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 126/258] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:59 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:00.218813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-fe1bdba8-05bc-45ae-98c3-54a00b29efc0 req-fd4d6da3-5a5a-4e6d-919b-6e4cbb2a3c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020a908b-0c09-4a49-9482-62d085fd1df3", "tag": "bfaafb6c-9eba-4966-9079-4cc52951697a"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:00.232704 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-fe1bdba8-05bc-45ae-98c3-54a00b29efc0 req-fd4d6da3-5a5a-4e6d-919b-6e4cbb2a3c04 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:00.233495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-fe1bdba8-05bc-45ae-98c3-54a00b29efc0 req-fd4d6da3-5a5a-4e6d-919b-6e4cbb2a3c04 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:00.234508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-fe1bdba8-05bc-45ae-98c3-54a00b29efc0 req-fd4d6da3-5a5a-4e6d-919b-6e4cbb2a3c04 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:00.248088 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-fe1bdba8-05bc-45ae-98c3-54a00b29efc0 req-fd4d6da3-5a5a-4e6d-919b-6e4cbb2a3c04 service nova] Creating event network-changed:bfaafb6c-9eba-4966-9079-4cc52951697a for instance 020a908b-0c09-4a49-9482-62d085fd1df3 on hv-cinder-86009 Oct 03 13:33:00.253774 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-fe1bdba8-05bc-45ae-98c3-54a00b29efc0 req-fd4d6da3-5a5a-4e6d-919b-6e4cbb2a3c04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047282 Oct 03 13:33:00.254565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 127/259] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:00.260709 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-4f9dae2c-c27e-4126-8d23-a82eabf26ca5 req-33212139-1426-4450-95d2-fb98b32f79bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca377db-f0f6-4888-a94e-cfde65e470e9", "name": "network-vif-plugged", "status": "completed", "tag": "b7b4c568-efe4-4d19-8923-b411916ba1a1"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:00.271514 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-4f9dae2c-c27e-4126-8d23-a82eabf26ca5 req-33212139-1426-4450-95d2-fb98b32f79bf service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:00.272004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-4f9dae2c-c27e-4126-8d23-a82eabf26ca5 req-33212139-1426-4450-95d2-fb98b32f79bf service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:00.272442 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-4f9dae2c-c27e-4126-8d23-a82eabf26ca5 req-33212139-1426-4450-95d2-fb98b32f79bf service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:00.285705 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-4f9dae2c-c27e-4126-8d23-a82eabf26ca5 req-33212139-1426-4450-95d2-fb98b32f79bf service nova] Creating event network-vif-plugged:b7b4c568-efe4-4d19-8923-b411916ba1a1 for instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 on hv-cinder-86009 Oct 03 13:33:00.285879 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:00.291678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-4f9dae2c-c27e-4126-8d23-a82eabf26ca5 req-33212139-1426-4450-95d2-fb98b32f79bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034997 Oct 03 13:33:00.292703 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 128/260] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:00.298039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:00.298323 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ec1a53dc-2bc6-4d02-bb29-cdeebeb31adb tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.530847 Oct 03 13:33:00.298753 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:00.299011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 133/261] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:32:59 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:00.305769 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:00.306316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:00.307555 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:00.308535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:00.309021 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:00.309484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:00.461837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:00.473301 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f68375f6-7958-45ad-bb66-313171d29903 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.179343 Oct 03 13:33:00.473936 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 129/262] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:00 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:01.013283 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:01.013956 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:01.020905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:01.021780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:01.022281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:01.023053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:01.023565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:01.024033 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:01.175305 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:01.188261 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-21c58995-38db-419f-bd4c-0389d999295a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.179829 Oct 03 13:33:01.188864 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 134/263] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:01 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:01.242369 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:01.243040 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:01.250647 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:01.251134 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:01.251576 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:01.252294 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:01.253024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:01.253485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:01.323340 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:01.324240 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:01.330926 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:01.332074 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:01.332693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:01.333667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:01.334143 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:01.334574 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:01.420073 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:01.429941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-606de12b-afa5-4d0f-9f47-1ea19d2629f4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.191418 Oct 03 13:33:01.430541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 130/264] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:01 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:01.500544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:01.501735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:01.511266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:01.512035 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:01.512741 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:01.513684 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:01.514362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:01.515141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:01.527160 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:01.535864 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f48e710a-bce4-481b-8abb-2efcd205abbc tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.216670 Oct 03 13:33:01.536958 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 135/265] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:01 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:01.678637 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:01.687637 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-204e0d03-b087-4b13-a729-88431f7f8c68 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.194096 Oct 03 13:33:01.688246 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 131/266] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:01 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:02.219570 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:02.220666 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:02.242375 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:02.243286 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:02.244091 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:02.245362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:02.245968 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:02.246523 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:02.400012 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:02.408999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c7e33d6b-f107-4470-9fb1-306c4b6f468d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.197072 Oct 03 13:33:02.409629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 136/267] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:02 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:02.464822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:02.465498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:02.468336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:02.474616 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:02.475008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:02.475446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:02.476219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:02.476685 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:02.477112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:02.549120 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=8 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:02.579975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:02.580910 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:02.589740 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:02.590483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:02.591019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:02.592146 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:02.592970 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:02.594093 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:02.637825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:02.646526 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d2382229-77e6-4156-a002-6e7849a0249e tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.186497 Oct 03 13:33:02.647143 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 132/268] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:02 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:02.712869 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:02.713574 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:02.721388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:02.721869 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:02.722314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:02.723030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:02.723496 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:02.723926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:02.791408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:02.800497 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1d8052b6-5c56-4657-9622-f868bae5d6b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.227053 Oct 03 13:33:02.801095 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 137/269] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:02 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:02.897178 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:02.907278 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1c519883-b794-4699-885b-e1f06ea957a9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.198466 Oct 03 13:33:02.908087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 133/270] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:02 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:03.442158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:03.443006 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:03.451241 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:03.451741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:03.452351 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:03.453077 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:03.453702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:03.454137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:03.611569 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:03.621438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1e8d078c-b80a-4c48-88c7-bcc434df1040 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.184293 Oct 03 13:33:03.622323 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 138/271] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:03 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:03.671569 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:03.672292 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:03.678970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:03.679620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:03.680155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:03.680982 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:03.682188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:03.682783 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:03.829060 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:03.830206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:03.840923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:03.841818 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:03.842482 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:03.843748 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:03.844575 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:03.845358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:03.859735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:03.870967 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cd17f019-3aab-4608-91ee-05f01d6d1733 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.203184 Oct 03 13:33:03.871681 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 134/272] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:03 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:03.934570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:03.935303 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:03.942479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:03.942980 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:03.943427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:03.948988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:03.948988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:03.948988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:04.010113 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:04.019303 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9c289dad-c1e1-4087-98fc-fd5960dc3b57 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.198067 Oct 03 13:33:04.019939 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 139/273] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:03 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:04.142784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:04.152294 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f84cdff4-9241-43a5-a4de-01da29a77486 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.221965 Oct 03 13:33:04.152781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 135/274] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:03 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:04.662052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:04.662625 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:04.671326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:04.672075 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:04.672767 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:04.674048 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:04.674867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:04.675632 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:04.900056 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:04.901956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:04.912005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:04.913068 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:04.913828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:04.915238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:04.916069 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:04.916855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:05.070135 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:05.098774 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-707ba9e1-b38d-49dc-9402-f8afb5d3dc55 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.441485 Oct 03 13:33:05.103500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 140/275] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:04 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:05.130693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:05.140904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:05.188864 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:05.203642 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:05.207942 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:05.210987 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:05.229235 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:05.230259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:05.287082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:05.308570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-863b1df8-b7fb-4b9d-8f12-b6990c6f25c9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.416147 Oct 03 13:33:05.311109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 136/276] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:04 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:05.324641 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:05.326501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:05.355735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:05.357658 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:05.360363 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:05.364182 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:05.366178 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:05.368127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:05.574229 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:05.583193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-40f5d78c-e1bc-4524-9a21-cd166373ad3c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.473334 Oct 03 13:33:05.583934 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 141/277] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:05 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:05.607886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:05.617197 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f3838cba-facb-4064-b9d7-cbfb69c36f1c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.303102 Oct 03 13:33:05.617963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 137/278] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:05 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:06.154023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:06.155355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:06.170699 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:06.171791 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:06.172814 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:06.174215 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:06.175155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:06.175881 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:06.356271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:06.360071 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:06.361209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:06.371356 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-744df39a-ac61-44e4-a3cf-2fd63579d479 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.225385 Oct 03 13:33:06.372355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 142/279] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:06 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:06.372907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:06.373599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:06.374183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:06.375107 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:06.376092 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:06.377239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:06.629968 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:06.631695 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:06.640832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:06.645132 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:06.647840 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:06.647840 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:06.648446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:06.649715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:06.651914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:06.655789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-933fff49-c63c-4b39-ace9-fad4e06fce6f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.303335 Oct 03 13:33:06.662262 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 138/280] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:06 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:06.685497 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:06.687032 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:06.698606 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:06.699495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:06.700311 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:06.701627 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:06.703385 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:06.704208 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:06.898210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:06.911867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-687e9df4-02ea-4e01-8a5b-d23a5529b42b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.290141 Oct 03 13:33:06.913010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 143/281] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:06 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:06.977023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:06.984585 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1de9d19b-3215-4d0c-8bbd-9ddbd13e9546 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.320699 Oct 03 13:33:06.985183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 139/282] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:06 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:07.371587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-e4310f92-62eb-44fc-94b0-76db71a09d96 req-d006f67e-98af-48c8-85de-59e65d518744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd04a837-3721-447a-82af-4be3bd4a2d8b", "name": "network-vif-plugged", "status": "completed", "tag": "a26ac185-9533-4e8e-9f6b-3c2a32872f1a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:07.393095 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e4310f92-62eb-44fc-94b0-76db71a09d96 req-d006f67e-98af-48c8-85de-59e65d518744 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:07.393095 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e4310f92-62eb-44fc-94b0-76db71a09d96 req-d006f67e-98af-48c8-85de-59e65d518744 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:07.393095 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e4310f92-62eb-44fc-94b0-76db71a09d96 req-d006f67e-98af-48c8-85de-59e65d518744 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:07.404886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:07.406255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:07.413585 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-e4310f92-62eb-44fc-94b0-76db71a09d96 req-d006f67e-98af-48c8-85de-59e65d518744 service nova] Creating event network-vif-plugged:a26ac185-9533-4e8e-9f6b-3c2a32872f1a for instance bd04a837-3721-447a-82af-4be3bd4a2d8b on hv-cinder-86009 Oct 03 13:33:07.414972 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:07.415687 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:07.417732 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:07.418520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:07.419214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:07.419649 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:07.422405 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-e4310f92-62eb-44fc-94b0-76db71a09d96 req-d006f67e-98af-48c8-85de-59e65d518744 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058383 Oct 03 13:33:07.424134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 144/283] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:07.599084 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:07.614203 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4b76d8ed-385a-422c-98ce-e6ffa3c373a0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.217589 Oct 03 13:33:07.614857 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 140/284] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:07 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:07.689627 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:07.690345 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:07.698362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:07.698975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:07.699429 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:07.700184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:07.700678 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:07.701173 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:07.889304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:07.899505 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a63c91f2-c062-417f-8791-5964aee0a617 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.214450 Oct 03 13:33:07.904827 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 145/285] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:07 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:07.946171 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:07.947127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:07.953878 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:07.954373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:07.954872 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:07.955594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:07.956056 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:07.956484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:07.961015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=100 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:08.022490 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:08.023465 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:08.033492 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:08.034294 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:08.034875 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:08.038416 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:08.039337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:08.040337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:08.191984 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:08.203458 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-84bc659b-9e50-4d63-9974-85bde31af998 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.261370 Oct 03 13:33:08.204206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 141/286] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:07 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:08.311165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:08.324806 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ce372312-66c5-4433-a0ea-8e0e802d9a60 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1363 microversion: 2.1 time: 0.315382 Oct 03 13:33:08.325988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 146/287] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:08 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:08.646323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:08.647604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:08.659761 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:08.660744 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:08.661668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:08.662848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:08.663696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:08.664549 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:08.914281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:08.933179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b9a481b1-5b0a-4118-8e68-f25b2ebe2db4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.295329 Oct 03 13:33:08.934296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 142/288] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:08 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:08.944885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:08.947175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:08.958974 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:08.959693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:08.960501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:08.961503 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:08.962238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:08.963584 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:09.232880 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:09.246593 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:09.247677 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:09.256959 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:09.257803 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:09.258628 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:09.259386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:09.260049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:09.260873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:09.263573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a41bac6f-aab9-4f09-bdca-60bd6d1cd59d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.325474 Oct 03 13:33:09.280330 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 147/289] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:08 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:09.375536 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:09.376704 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:09.407004 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:09.407602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:09.410907 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:09.413947 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:09.416784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:09.417768 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:09.633130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:09.649431 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-44602410-9b8b-4900-a05f-0f4738c3b962 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.407716 Oct 03 13:33:09.651063 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 143/290] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:09 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:09.824357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:09.833266 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-07602371-dd4c-4c6c-9c9a-078ea38925d8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1550 microversion: 2.1 time: 0.483027 Oct 03 13:33:09.833985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 148/291] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:09 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1550 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:09.860257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:09.860895 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:09.868167 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:09.868668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:09.869747 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:09.870478 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:09.870942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:09.871379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:09.965184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:09.966441 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:09.977523 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:09.979199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:09.979953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:09.980963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8dac51bf-b390-4655-8eb2-edbda59f4ef0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124767 Oct 03 13:33:09.981199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:09.981993 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 144/292] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 3 13:33:09 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:09.982159 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:09.982816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:10.308101 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:10.309322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:10.320730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:10.321758 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:10.323221 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:10.324612 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:10.325515 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:10.326296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:10.562247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:10.573399 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0215f4b0-29a1-4466-a074-5d661848fb32 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.273980 Oct 03 13:33:10.574304 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 145/293] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:10 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:10.664124 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:10.672777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:10.682766 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:10.683661 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-75442b38-fba4-430f-a7fc-eafc40b757a9 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.723649 Oct 03 13:33:10.683850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:10.690480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 149/294] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:09 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:10.692331 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:10.693110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:10.693758 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:10.694684 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:10.695676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:10.696289 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:10.885173 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:10.894543 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4b260713-f0fe-43e7-b4ca-fc557377e4e9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1314 microversion: 2.1 time: 0.223053 Oct 03 13:33:10.895127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 146/295] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:10 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:11.611578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-01326cc3-c662-4e9c-b5b5-b494c4ad60ed req-12fb1e07-87ce-42f8-812f-392e7de30680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020a908b-0c09-4a49-9482-62d085fd1df3", "name": "network-vif-plugged", "status": "completed", "tag": "bfaafb6c-9eba-4966-9079-4cc52951697a"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:11.626163 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:11.637173 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:11.648548 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:11.649432 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:11.650426 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:11.651746 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:11.652621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:11.653424 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:11.660387 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-01326cc3-c662-4e9c-b5b5-b494c4ad60ed req-12fb1e07-87ce-42f8-812f-392e7de30680 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:11.661612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-01326cc3-c662-4e9c-b5b5-b494c4ad60ed req-12fb1e07-87ce-42f8-812f-392e7de30680 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:11.662370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-01326cc3-c662-4e9c-b5b5-b494c4ad60ed req-12fb1e07-87ce-42f8-812f-392e7de30680 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:11.687700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-01326cc3-c662-4e9c-b5b5-b494c4ad60ed req-12fb1e07-87ce-42f8-812f-392e7de30680 service nova] Creating event network-vif-plugged:bfaafb6c-9eba-4966-9079-4cc52951697a for instance 020a908b-0c09-4a49-9482-62d085fd1df3 on hv-cinder-86009 Oct 03 13:33:11.697884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-01326cc3-c662-4e9c-b5b5-b494c4ad60ed req-12fb1e07-87ce-42f8-812f-392e7de30680 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094748 Oct 03 13:33:11.698974 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 150/296] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:11.739330 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:11.745844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:11.778893 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:11.779911 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:11.782014 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:11.785363 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:11.787205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:11.788198 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:11.896103 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:11.905327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b9f19116-cbe0-413f-841d-ab3ac6b24291 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.288975 Oct 03 13:33:11.905994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 147/297] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:11 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:11.937999 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:11.938989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:11.949440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:11.949440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:11.949440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:11.949440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:11.950046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:11.950596 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:12.078786 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:12.091254 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ad444a19-7454-450b-8635-7b53cee2f6d1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.370127 Oct 03 13:33:12.093519 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 151/298] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:11 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:12.101488 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-14bfb1db-489e-4404-9afb-ab3fe620dc28 req-5b7af632-5eaa-4326-b9e7-63cb3e9a5f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca377db-f0f6-4888-a94e-cfde65e470e9", "tag": "b7b4c568-efe4-4d19-8923-b411916ba1a1"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:12.121401 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-14bfb1db-489e-4404-9afb-ab3fe620dc28 req-5b7af632-5eaa-4326-b9e7-63cb3e9a5f78 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:12.122672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-14bfb1db-489e-4404-9afb-ab3fe620dc28 req-5b7af632-5eaa-4326-b9e7-63cb3e9a5f78 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:12.124906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-14bfb1db-489e-4404-9afb-ab3fe620dc28 req-5b7af632-5eaa-4326-b9e7-63cb3e9a5f78 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:12.151715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-14bfb1db-489e-4404-9afb-ab3fe620dc28 req-5b7af632-5eaa-4326-b9e7-63cb3e9a5f78 service nova] Creating event network-changed:b7b4c568-efe4-4d19-8923-b411916ba1a1 for instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 on hv-cinder-86009 Oct 03 13:33:12.160344 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-14bfb1db-489e-4404-9afb-ab3fe620dc28 req-5b7af632-5eaa-4326-b9e7-63cb3e9a5f78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064525 Oct 03 13:33:12.161645 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 152/299] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:12.174086 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:12.188625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-54f5e342-cda4-4bf5-83d3-4b05120f4846 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1497 microversion: 2.1 time: 0.255995 Oct 03 13:33:12.189696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 148/300] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:11 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:12.854579 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:12.855997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:12.863099 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:12.863902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:12.864352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:12.865271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:12.865779 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:12.866202 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:12.899222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:33:12.942431 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:12.943675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:12.951318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:12.951828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:12.952549 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:12.953659 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:12.954561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:12.955280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:13.070047 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b9797ff2-33bc-4698-b413-bfd53a35022e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 204 len: 0 microversion: 2.1 time: 0.220618 Oct 03 13:33:13.076129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 153/301] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:33:12 2022] DELETE /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 13:33:13.083912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:13.085001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:13.094207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:13.095061 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:13.095690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:13.096622 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:13.097259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:13.098076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:13.179846 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:13.200146 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a36e776e-2d38-4fb4-bd4f-b308cdc5e595 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.261061 Oct 03 13:33:13.201500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 149/302] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:12 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:13.227965 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:13.229718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:13.242652 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:13.243466 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:13.244578 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:13.246191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:13.247033 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:13.248022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:13.334809 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:13.357809 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b16eab3f-cca2-44a9-b394-8e4363b2f72f tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1503 microversion: 2.1 time: 0.279898 Oct 03 13:33:13.362068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 154/303] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:13 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:13.378694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:13.379195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:13.386517 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:13.387247 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:13.387717 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:13.388173 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:13.388612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:13.389223 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:13.417588 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8f65a6f5-4b89-4772-ad12-fdd9d536ea50 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/ips" status: 200 len: 150 microversion: 2.1 time: 0.053462 Oct 03 13:33:13.418458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 155/304] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:33:13 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:13.479957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:13.495370 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-39bdf186-3d08-43f7-b5e7-7946117291cf tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.291980 Oct 03 13:33:13.496075 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 150/305] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:13 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:14.224237 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:14.224848 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:14.232546 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:14.233031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:14.233543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:14.234182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:14.234630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:14.235053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:14.386874 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:14.387754 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:14.394887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:14.397266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:14.398131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:14.398856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:14.400356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:14.401220 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:14.401965 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:14.408839 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-16b17422-d3a2-4308-a752-d13ca3a60fc3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.188126 Oct 03 13:33:14.409604 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 156/306] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:14 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:14.532957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:14.533622 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:14.540217 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:14.540824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:14.541264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:14.542410 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:14.542873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:14.542873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:14.572509 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:14.582132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f06a7d0c-a2f7-4de8-be71-82c757102ade tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1503 microversion: 2.1 time: 0.201005 Oct 03 13:33:14.582749 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 151/307] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:14 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:14.685292 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:14.693342 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-29b76f42-fe1e-4a76-8814-77e7a56019bd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.164548 Oct 03 13:33:14.693953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 157/308] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:14 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:14.935695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "782d7b63-609f-4c91-8040-8ac420416026"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:14.938542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:14.945671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:14.946161 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:14.946700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:14.947361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:14.947814 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:14.948236 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:15.447915 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:15.448624 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:15.455540 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:15.456022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:15.456455 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:15.457162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:15.457642 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:15.458071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:15.868746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:15.877084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c1002ab4-9eac-4ad9-941a-54cdff2816f5 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1319 microversion: 2.1 time: 0.433618 Oct 03 13:33:15.878045 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 158/309] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:15 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:15.883303 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:15.884513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:15.891895 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:15.892850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:15.893378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:15.894347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:15.894903 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:15.895468 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:16.052205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:16.061540 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1ca74609-89b5-4e99-880c-dbb5361c8e96 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1503 microversion: 2.1 time: 0.182319 Oct 03 13:33:16.062134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 159/310] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:15 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:16.067171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:16.067786 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:16.075263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:16.075856 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:16.076348 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:16.077125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:16.077682 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:16.078170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:16.343739 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:16.368372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d3044eff-c571-423f-ba59-8f135453518c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.304454 Oct 03 13:33:16.369419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 160/311] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:16 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:16.479802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2469502d-479a-450d-b20b-66ea19b32261 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.547971 Oct 03 13:33:16.480871 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 152/312] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:33:14 2022] POST /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 194 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:16.905169 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:16.905830 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:16.913079 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:16.914012 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:16.914012 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:16.914758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:16.915222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:16.917224 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:17.094418 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:17.096125 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:17.115575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:17.118279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:17.121809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:17.123811 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:17.124921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:17.126059 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:17.208252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:17.217902 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-134b72e6-86c6-44e1-8e5f-5b75931cd2a2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1461 microversion: 2.1 time: 0.133507 Oct 03 13:33:17.218907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 153/313] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:17 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1461 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:17.223686 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-e9a15e6d-a61a-4d21-8b16-8fce1d273d1c req-48a71213-d0bd-4b26-a938-b109d98b05cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd04a837-3721-447a-82af-4be3bd4a2d8b", "name": "network-vif-deleted", "tag": "a26ac185-9533-4e8e-9f6b-3c2a32872f1a"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:17.229201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:17.234941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e9a15e6d-a61a-4d21-8b16-8fce1d273d1c req-48a71213-d0bd-4b26-a938-b109d98b05cc service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:17.235423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e9a15e6d-a61a-4d21-8b16-8fce1d273d1c req-48a71213-d0bd-4b26-a938-b109d98b05cc service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:17.236072 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e9a15e6d-a61a-4d21-8b16-8fce1d273d1c req-48a71213-d0bd-4b26-a938-b109d98b05cc service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:17.246740 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9e4b2d88-69c4-46b9-b5a6-5156b9cd7645 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1508 microversion: 2.1 time: 0.345374 Oct 03 13:33:17.248041 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 161/314] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:16 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1508 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:17.250818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-e9a15e6d-a61a-4d21-8b16-8fce1d273d1c req-48a71213-d0bd-4b26-a938-b109d98b05cc service nova] Creating event network-vif-deleted:a26ac185-9533-4e8e-9f6b-3c2a32872f1a for instance bd04a837-3721-447a-82af-4be3bd4a2d8b on hv-cinder-86009 Oct 03 13:33:17.256354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-e9a15e6d-a61a-4d21-8b16-8fce1d273d1c req-48a71213-d0bd-4b26-a938-b109d98b05cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036183 Oct 03 13:33:17.256970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 154/315] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:17.414359 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:17.416427 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:17.429212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:17.430475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:17.431537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:17.432282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:17.432793 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:17.433394 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:17.633135 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:17.643343 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d3d57637-3a73-455a-9bf6-faa9aa9c709a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.237736 Oct 03 13:33:17.658437 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 162/316] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:17 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:18.261438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:18.262777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:18.274946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:18.275856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:18.276653 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:18.277929 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:18.278765 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:18.279584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:18.338725 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:18.341778 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:18.342437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:18.343510 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:18.343661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid bd04a837-3721-447a-82af-4be3bd4a2d8b {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:18.399638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:18.408360 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0e7e37e2-97db-45ee-b1e8-a1803baf6346 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 200 len: 1304 microversion: 2.1 time: 0.155035 Oct 03 13:33:18.409254 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 155/317] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:18 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:18.672555 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:18.673228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:18.680404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:18.681098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:18.681576 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:18.682456 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:18.682909 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:18.683328 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:18.863315 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:18.872640 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-703dbfcb-0bd8-4372-86ea-c3b1cab23735 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.204192 Oct 03 13:33:18.873565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 163/318] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:18 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:19.438325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:19.439324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: bd04a837-3721-447a-82af-4be3bd4a2d8b] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:19.446558 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:19.447782 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:19.448291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:19.449035 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:19.449517 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:19.449950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:19.466362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] HTTP exception thrown: Instance bd04a837-3721-447a-82af-4be3bd4a2d8b could not be found. Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Request method failure captured: Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b HTTP/1.1 Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuR4qUegOxglj9_5TQQ-w0atzGMJEi2mj-cqvzGkRN0CD4WfReEovFQMoQZv6dZzE27VbXKqur7VJ2VajRGYvZCJwDzo69LXZ-r-H1s0NDTPrZyqfBJNFmRxJYJ1JhgEjIpJqOh2TLBZCp8tIuBRxoSl7YJg_cWk23cZaZVScXJJ-sA Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: afa1958afb874a0cba4c57df10f2ce08 Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesActionsTest-2129919452 Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:33:19.468053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/afa1958afb874a0cba4c57df10f2ce08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/afa1958afb874a0cba4c57df10f2ce08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_afa1958afb874a0cba4c57df10f2ce08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/afa1958afb874a0cba4c57df10f2ce08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesActionsTest-2129919452 Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: afa1958afb874a0cba4c57df10f2ce08 Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesActionsTest-2129919452 Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesActionsTest-2129919452-project Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 9b293568e74c4c69baee5cb29013ab6d Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesActionsTest-2129919452-project Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance bd04a837-3721-447a-82af-4be3bd4a2d8b could not be found. Oct 03 13:33:19.470324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': 'bd04a837-3721-447a-82af-4be3bd4a2d8b'} Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd04a837-3721-447a-82af-4be3bd4a2d8b could not be found. Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:33:19.471720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd04a837-3721-447a-82af-4be3bd4a2d8b could not be found. Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd04a837-3721-447a-82af-4be3bd4a2d8b could not be found. Oct 03 13:33:19.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:19.475730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Returning 404 to user: Instance bd04a837-3721-447a-82af-4be3bd4a2d8b could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:33:19.475730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8758cc3c-e89f-468f-b752-153c91061c39 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b" status: 404 len: 111 microversion: 2.1 time: 0.039061 Oct 03 13:33:19.475730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 156/319] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:19 2022] GET /compute/v2.1/servers/bd04a837-3721-447a-82af-4be3bd4a2d8b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:33:19.605796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1345798524", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "networks": [{"uuid": "eaea14e2-06e5-440b-8c67-d4a587c52b53"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:19.666827 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] validate_networks() for [('eaea14e2-06e5-440b-8c67-d4a587c52b53', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:33:19.905879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:19.908377 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:19.916359 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:19.917343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:19.918036 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:19.919137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:19.919769 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:19.920371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:20.107000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:20.110888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:20.124430 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b8b11623-b954-496e-b66f-3a523761f880 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.222506 Oct 03 13:33:20.125484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 157/320] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:19 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:20.194076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:33:20.194944 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:33:20.195410 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:33:20.195934 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:33:20.196466 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:33:20.206990 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:20.207513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:20.207957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:20.208725 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:20.209192 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:20.209662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:20.229481 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Getting quotas for project afa1958afb874a0cba4c57df10f2ce08. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:33:20.231159 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:20.236573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Getting quotas for user 9b293568e74c4c69baee5cb29013ab6d and project afa1958afb874a0cba4c57df10f2ce08. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:33:20.250661 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:33:20.253325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:33:20.307682 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-de1c8cdd-ea32-4b5e-a216-cd2e904f8d4b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706459 Oct 03 13:33:20.308344 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 164/321] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 13:33:20.322155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2b18863c-075e-4446-9e2e-8f88bae733b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:20.323008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2b18863c-075e-4446-9e2e-8f88bae733b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:20.401999 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-2b18863c-075e-4446-9e2e-8f88bae733b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:20.410873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2b18863c-075e-4446-9e2e-8f88bae733b9 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1214 microversion: 2.1 time: 0.094686 Oct 03 13:33:20.411670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 158/322] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:20 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:21.156316 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:21.159633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:21.172031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:21.172951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:21.173590 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:21.174476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:21.175110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:21.175706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:21.379794 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:21.388444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1058492b-48cc-4f97-95fe-f511ded6d924 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.240323 Oct 03 13:33:21.389111 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 165/323] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:21 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:21.436265 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:21.436872 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:21.443763 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:21.444266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:21.444707 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:21.445735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:21.446202 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:21.446702 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:21.520371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:21.529408 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b6ea0c04-8b68-4bc4-b9ee-25d906c96f9c tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1266 microversion: 2.1 time: 0.097048 Oct 03 13:33:21.530051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 159/324] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:21 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:22.414009 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:22.414925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:22.423538 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:22.424226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:22.424741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:22.425807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:22.426445 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:22.426954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:22.555423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:22.558194 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:22.571216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:22.573188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:22.573784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:22.574634 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:22.575410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:22.576339 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:22.667915 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:22.680004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:22.683365 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d109cc8b-f582-4fd6-8b20-25e22fe0112c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.273525 Oct 03 13:33:22.684887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 166/325] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:22 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:22.695795 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b8e4264d-d85f-4b87-95f8-b7bb8263d59b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1272 microversion: 2.1 time: 0.144772 Oct 03 13:33:22.697526 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 160/326] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:22 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:23.730904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:23.731513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:23.734242 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:23.735550 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:23.738527 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:23.739311 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:23.739742 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:23.740452 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:23.741099 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:23.741847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:23.750066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:23.751305 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:23.752995 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:23.755026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:23.757164 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:23.758441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:23.766329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:24.078079 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:24.094722 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a4d46ebb-d041-4492-928c-053e9092483b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.368880 Oct 03 13:33:24.094935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:24.100190 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 167/327] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:23 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:24.107019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-e75d890c-d821-4357-8eca-96b1d94ef3d9 req-9f64f2dc-a0da-4a3c-bc3a-a9752336eb00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8bd9d2c-183b-420f-a839-1880c1e908da", "tag": "f38e29f4-feb2-4591-b970-761c43afb601"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:24.113733 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-70ad044f-3e86-4e5c-bfe4-364e62b2738e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.383574 Oct 03 13:33:24.113733 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 161/328] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:23 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:24.120056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e75d890c-d821-4357-8eca-96b1d94ef3d9 req-9f64f2dc-a0da-4a3c-bc3a-a9752336eb00 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:24.120706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e75d890c-d821-4357-8eca-96b1d94ef3d9 req-9f64f2dc-a0da-4a3c-bc3a-a9752336eb00 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:24.121147 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e75d890c-d821-4357-8eca-96b1d94ef3d9 req-9f64f2dc-a0da-4a3c-bc3a-a9752336eb00 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:24.135288 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-e75d890c-d821-4357-8eca-96b1d94ef3d9 req-9f64f2dc-a0da-4a3c-bc3a-a9752336eb00 service nova] Creating event network-changed:f38e29f4-feb2-4591-b970-761c43afb601 for instance e8bd9d2c-183b-420f-a839-1880c1e908da on hv-cinder-86009 Oct 03 13:33:24.141170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-e75d890c-d821-4357-8eca-96b1d94ef3d9 req-9f64f2dc-a0da-4a3c-bc3a-a9752336eb00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039354 Oct 03 13:33:24.141936 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 168/329] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:25.137806 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:25.138688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:25.146051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:25.146549 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:25.146997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:25.147730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:25.148188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:25.148624 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:25.162257 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:25.164002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:25.177308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:25.178256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:25.179040 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:25.180306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:25.181129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:25.181941 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:25.327182 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:25.343294 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-472ebe83-b2db-45c0-a626-e75ebcf08e6d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.210382 Oct 03 13:33:25.344350 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 162/330] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:25 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:25.374019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:25.382411 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-82cad33d-c9a9-40cc-8f7a-4a2c9ff25f6b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.229222 Oct 03 13:33:25.383005 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 169/331] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:25 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:26.372259 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:26.374194 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:26.385620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:26.386699 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:26.387493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:26.388635 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:26.389240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:26.389821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:26.406837 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:26.407716 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:26.416245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:26.417221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:26.417906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:26.418873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:26.419545 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:26.420409 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:26.715485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:26.731275 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-584f04cb-2680-419a-ae6a-53b383e4233d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.366258 Oct 03 13:33:26.732368 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 163/332] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:26 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:26.824853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:26.833125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f4193919-05ec-41a4-9bd2-65a80b662328 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.430112 Oct 03 13:33:26.833775 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 170/333] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:26 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:27.619506 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-95d07efa-24e6-473e-9b7b-d63e84e365da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: .version_select at 0x7f7c21b2c1f0>, body: {"keypair": {"name": "tempest-keypair-1064142744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTEoo84625sPPbf1Dnd5ZcX/8940JDttJNPQHY6j7OdH664QklZnevSSWww/xppIpN82RIBlNPVRy3WEnAvC9XRncSF685sCyRk0l9Vr1wDtJEXjG+EFIvkvTKY2BSuFA=="}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:27.639478 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-95d07efa-24e6-473e-9b7b-d63e84e365da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:33:27.647367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-95d07efa-24e6-473e-9b7b-d63e84e365da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for user 98de1ccbabc64162a29cbce2cfe11600 and project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:33:27.685719 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-95d07efa-24e6-473e-9b7b-d63e84e365da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070333 Oct 03 13:33:27.686537 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 164/334] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:33:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:27.769736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:27.770513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:27.777483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:27.777483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:27.777483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:27.779628 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:27.780167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:27.780966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:27.857768 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:27.858726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:27.871233 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:27.872383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:27.873201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:27.874675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:27.875730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:27.876911 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:28.011023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:28.028932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b80e8a26-72d1-48b0-ae3a-6803c81dbea1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.262710 Oct 03 13:33:28.030326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 171/335] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:27 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:28.205206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:28.219547 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a33d7803-d2dd-43e9-827d-c65b2fd06475 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.366500 Oct 03 13:33:28.233316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 165/336] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:27 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:29.057234 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:29.058079 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:29.064879 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:29.065423 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:29.065886 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:29.066614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:29.067076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:29.067502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:29.263832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:29.265117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:29.270450 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:29.272718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:29.273279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:29.273962 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:29.274874 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:29.275719 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:29.276337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:29.285105 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1fae3dce-30f7-4f8c-bdeb-e4642726b78d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.232226 Oct 03 13:33:29.286365 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 172/337] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:29 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:29.546126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:29.562994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c9a98636-6144-4224-a41a-ac3634ba9e1b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.303461 Oct 03 13:33:29.565047 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 166/338] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:29 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:29.682839 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1347837441", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff8319e2-24e1-46c8-a6e2-568f9c4503d6"}], "security_groups": [{"name": "tempest-securitygroup--1310370427"}], "key_name": "tempest-keypair-1064142744", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:29.815011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] validate_networks() for [('ff8319e2-24e1-46c8-a6e2-568f9c4503d6', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:33:30.218925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:30.244698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:30.313385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:33:30.313850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:33:30.314334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:33:30.314743 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:33:30.315185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:33:30.326981 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.327529 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.328221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.329213 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.329715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.330138 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.330784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:30.336332 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:30.355518 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.356731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.357719 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:33:30.357963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.359410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.360103 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.361340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.362930 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for user 98de1ccbabc64162a29cbce2cfe11600 and project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:33:30.385727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:33:30.390121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:33:30.474417 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-31328d89-e688-4cec-b0a7-dafb2a3e0a7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800554 Oct 03 13:33:30.475645 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 173/339] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:33:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 13:33:30.500024 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d52647c0-4821-4680-af6f-950469600ae7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:30.501876 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d52647c0-4821-4680-af6f-950469600ae7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:30.592785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d52647c0-4821-4680-af6f-950469600ae7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:30.604111 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d52647c0-4821-4680-af6f-950469600ae7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1242 microversion: 2.1 time: 0.116911 Oct 03 13:33:30.604769 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 174/340] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:30 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:30.605852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:30.611518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:30.613126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:30.621312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.621843 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.622012 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e3a09b6c-b0d0-499c-a956-bad50de6c0ce tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1503 microversion: 2.1 time: 0.298934 Oct 03 13:33:30.622304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.623389 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.623536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 167/341] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:30 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:30.624150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.624776 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.648258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "391a97b2-1b9e-4db3-aad4-dc7f9decf312"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:30.654681 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:30.661282 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.661832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.662279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.663212 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.663478 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.663900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.704926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] HTTP exception thrown: Cannot 'attach_volume' instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 while it is in vm_state rescued Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Request method failure captured: Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: POST /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8/os-volume_attachments HTTP/1.1 Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 74 Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQJ7dhZr3bTNwCRdkxpZcGfMZtRbPiQ_g8W8amBWRT5xBJBdaHowxgIwy1MxrAMeQWsTUDB6AoGe2ot7uPrIZ9qSg2baCmAomCZFfeGl0_o15iXO24ZajYZNt0VJksLAM0TMntentqEyhwpaffWXizyBY7hzYDtJDLRgaQhpHoZeEI Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:33:30.707284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: ae71fd7ba4334d0d813cbc0c06e3686e Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {"volumeAttachment": {"volumeId": "391a97b2-1b9e-4db3-aad4-dc7f9decf312"}} Oct 03 13:33:30.710137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Cannot 'attach_volume' instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 while it is in vm_state rescued Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'server_id': '4b7a7e49-20a7-45bc-bc98-7af878fc50a8', 'body': {'volumeAttachment': {'volumeId': '391a97b2-1b9e-4db3-aad4-dc7f9decf312'}}} Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:33:30.712046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 while it is in vm_state rescued Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:33:30.714564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:33:30.716933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:33:30.716933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:33:30.716933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 while it is in vm_state rescued Oct 03 13:33:30.716933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:33:30.716933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Returning 409 to user: Cannot 'attach_volume' instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 while it is in vm_state rescued {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:33:30.716933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8305bbf0-ea59-490d-8ea3-3febf11261a4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065556 Oct 03 13:33:30.716933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 168/342] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:33:30 2022] POST /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 03 13:33:30.723317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:30.724181 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:30.742064 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.742064 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.746570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.746570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.747532 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.748276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.813274 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:30.837256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0d8decd2-a49c-4176-8dac-5567bd6be927 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.231018 Oct 03 13:33:30.854197 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 175/343] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:30 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:30.861224 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ec25e392-2b5d-45ff-a88b-6f16830d6320 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8/action" status: 202 len: 0 microversion: 2.1 time: 0.143521 Oct 03 13:33:30.862007 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 169/344] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:33:30 2022] POST /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:33:30.872191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:30.872816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:30.881101 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.881998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.882617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:30.884218 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:30.884973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:30.885741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:31.407079 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:31.421779 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ba94759a-9d81-46ea-a01a-8f2f3d08f8e3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1511 microversion: 2.1 time: 0.554137 Oct 03 13:33:31.435767 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 176/345] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:30 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1511 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:31.632536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:31.633389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:31.645826 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:31.647059 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:31.648063 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:31.650201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:31.651523 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:31.652499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:31.790168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:31.809092 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ea73ae3b-af04-4537-89ed-9b1dd3513309 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1294 microversion: 2.1 time: 0.182892 Oct 03 13:33:31.810548 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 170/346] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:31 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1294 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:31.867811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:31.869790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:31.885796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:31.887206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:31.888338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:31.891291 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:31.892588 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:31.893652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:32.026372 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-d00bcc6d-913e-4654-8a1f-4cfa66d7ddb2 req-b755c41b-e67f-43f2-b38e-96779e16cde9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bd9d2c-183b-420f-a839-1880c1e908da", "name": "network-vif-plugged", "status": "completed", "tag": "f38e29f4-feb2-4591-b970-761c43afb601"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:32.059308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-d00bcc6d-913e-4654-8a1f-4cfa66d7ddb2 req-b755c41b-e67f-43f2-b38e-96779e16cde9 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:32.059308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-d00bcc6d-913e-4654-8a1f-4cfa66d7ddb2 req-b755c41b-e67f-43f2-b38e-96779e16cde9 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:32.059308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-d00bcc6d-913e-4654-8a1f-4cfa66d7ddb2 req-b755c41b-e67f-43f2-b38e-96779e16cde9 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:32.085021 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-d00bcc6d-913e-4654-8a1f-4cfa66d7ddb2 req-b755c41b-e67f-43f2-b38e-96779e16cde9 service nova] Creating event network-vif-plugged:f38e29f4-feb2-4591-b970-761c43afb601 for instance e8bd9d2c-183b-420f-a839-1880c1e908da on hv-cinder-86009 Oct 03 13:33:32.094764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-d00bcc6d-913e-4654-8a1f-4cfa66d7ddb2 req-b755c41b-e67f-43f2-b38e-96779e16cde9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077025 Oct 03 13:33:32.096199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 171/347] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:33:32.165871 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:32.175245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d9d2bc3d-3fc0-4119-a9f1-29979bc2ff92 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.316437 Oct 03 13:33:32.175844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 177/348] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:31 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:32.477989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:32.479957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:32.495691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:32.497395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:32.498639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:32.502537 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:32.503818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:32.504607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:32.718392 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:32.729822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3eb3e6d9-f3c0-4f26-9088-708a417d5f5e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1511 microversion: 2.1 time: 0.266545 Oct 03 13:33:32.730744 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 172/349] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:32 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:32.854372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:32.855217 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:32.862476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:32.862981 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:32.863418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:32.864162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:32.864824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:32.865515 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:32.944007 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:32.952906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7d58417e-37fc-443c-b716-6a04440d8761 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1300 microversion: 2.1 time: 0.103501 Oct 03 13:33:32.953533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 178/350] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:32 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:33.200545 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:33.201387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:33.208168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:33.208668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:33.209113 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:33.209961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:33.210431 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:33.210868 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:33.406326 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:33.421091 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-99225cd3-9d0a-4e3c-b67e-a66110597e26 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.224578 Oct 03 13:33:33.422174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 173/351] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:33 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:33.755142 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:33.755784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:33.763783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:33.764270 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:33.764707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:33.765433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:33.765919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:33.766349 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:33.920144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:33.929175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d46a15a4-1f07-4fa9-b2bc-4bc6de71247e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1511 microversion: 2.1 time: 0.178803 Oct 03 13:33:33.930063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 179/352] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:33 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:33.976561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:33.977268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:33.984650 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:33.985145 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:33.985630 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:33.986354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:33.986822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:33.987251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:34.062691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:34.071235 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-04c6eaf2-4f2b-4e83-8001-9a0c6c7442eb tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1300 microversion: 2.1 time: 0.098510 Oct 03 13:33:34.072017 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 174/353] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:33 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:34.446999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:34.447641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:34.454057 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:34.454551 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:34.454982 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:34.455700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:34.456150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:34.456572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:34.622964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:34.631903 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-895587b3-1b4c-49a5-81ae-feff710161d0 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.189555 Oct 03 13:33:34.632509 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 180/354] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:34 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:34.954962 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:34.955582 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:34.962038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:34.962729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:34.963193 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:34.963926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:34.964425 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:34.964860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:35.095470 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:35.096635 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:35.104906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:35.105774 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:35.106366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:35.107335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:35.108032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:35.108692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:35.173792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:35.180502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:35.184340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-65669ee6-e3ee-4599-bb2c-0526a9d657a1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1511 microversion: 2.1 time: 0.233332 Oct 03 13:33:35.185093 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 175/355] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:34 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:35.189496 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4437289a-d945-4996-aca8-0d2b1d082a79 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1300 microversion: 2.1 time: 0.098461 Oct 03 13:33:35.190093 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 181/356] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:35 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:35.672206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:35.672996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:35.679678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:35.680224 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:35.680807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:35.681836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:35.682356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:35.682835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:35.699838 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:35.835345 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:35.850391 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3989b132-058d-4a36-8263-be6fb1bf71ff tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1314 microversion: 2.1 time: 0.182128 Oct 03 13:33:35.851486 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 176/357] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:35 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:36.216859 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:36.218144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:36.222465 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:36.223667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:36.231422 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:36.235258 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:36.236034 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:36.236956 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:36.237633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:36.238266 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:36.239636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:36.240523 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:36.241334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:36.243937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:36.245521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:36.247100 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:36.431618 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:36.442158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-29bbd89f-e0e4-4af6-8bad-f572c0eecb7f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1300 microversion: 2.1 time: 0.231111 Oct 03 13:33:36.442848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 177/358] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:36 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1300 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:36.591362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:36.604958 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-27d55792-ef0f-47e7-8bb5-3357b765249a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1511 microversion: 2.1 time: 0.394303 Oct 03 13:33:36.605956 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 182/359] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:36 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:36.891280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:36.891721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:36.898060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:36.898556 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:36.899545 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:36.900340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:36.900992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:36.901684 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:37.056111 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:37.065025 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-69452a71-9862-4c02-ba93-bef0da2a70ce tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1497 microversion: 2.1 time: 0.177777 Oct 03 13:33:37.065583 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 178/360] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:36 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:37.469874 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:37.472855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:37.485242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:37.486184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:37.486962 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:37.488368 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:37.489243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:37.490071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:37.635502 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:37.636640 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:37.648605 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:37.650567 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:37.651307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:37.652514 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:37.653329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:37.654086 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:37.662167 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=6 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:37.736513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:37.748236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0a079027-ff1f-4f1b-93e4-7f6741a900d3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.285421 Oct 03 13:33:37.749051 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 183/361] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:37 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:37.849799 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:37.859389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e80da9a7-a86b-4170-8bc1-3a42891f0a9c tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1517 microversion: 2.1 time: 0.233234 Oct 03 13:33:37.860113 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 179/362] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:37 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1517 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:37.878246 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:37.879202 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:37.891706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:37.892325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:37.893009 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:37.894074 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:37.894858 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:37.896211 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:37.950385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:33:38.029842 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:38.078921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-50dea9fb-35bc-4721-99b1-c3de426a5260 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 204 len: 0 microversion: 2.1 time: 0.210134 Oct 03 13:33:38.079770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 184/363] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:33:37 2022] DELETE /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:33:38.094136 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:38.095000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:38.106684 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:38.107360 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:38.108038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:38.109073 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:38.110368 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:38.111000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:38.331100 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:38.356378 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5fde258f-5488-475b-bac4-f08c3e65dfdf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1503 microversion: 2.1 time: 0.269305 Oct 03 13:33:38.357390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 180/364] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:38 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:38.784305 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:38.786513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:38.795831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:38.796480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:38.796923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:38.798803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:38.799322 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:38.799953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:39.064608 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:39.076692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e5f96fc1-f98a-4d04-ad3f-61690a648441 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.298198 Oct 03 13:33:39.078297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 185/365] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:38 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:39.298282 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-e02741ee-646d-44ef-a6ef-81e076351e4a req-ace92909-532d-46c8-a933-dd67e683e427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1530d3cd-a03d-4ccc-bf56-064b83e978c8", "tag": "fb7024a0-6b02-454f-ba31-1290a4622c59"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:39.311978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e02741ee-646d-44ef-a6ef-81e076351e4a req-ace92909-532d-46c8-a933-dd67e683e427 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:39.312452 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e02741ee-646d-44ef-a6ef-81e076351e4a req-ace92909-532d-46c8-a933-dd67e683e427 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:39.312978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e02741ee-646d-44ef-a6ef-81e076351e4a req-ace92909-532d-46c8-a933-dd67e683e427 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:39.327978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-e02741ee-646d-44ef-a6ef-81e076351e4a req-ace92909-532d-46c8-a933-dd67e683e427 service nova] Creating event network-changed:fb7024a0-6b02-454f-ba31-1290a4622c59 for instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 on hv-cinder-86009 Oct 03 13:33:39.333376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-e02741ee-646d-44ef-a6ef-81e076351e4a req-ace92909-532d-46c8-a933-dd67e683e427 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038966 Oct 03 13:33:39.334350 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 181/366] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:33:39.388001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:39.389395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:39.397772 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:39.398283 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:39.398726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:39.399501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:39.399943 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:39.400475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:39.437027 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-85187554-e535-4418-ad3f-b24d7de4ac1a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'create', calling method: .version_select at 0x7f7c227d6dc0>, body: {"keypair": {"name": "tempest-keypair-66205088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL2nd5BP5JcvDrbkb7Dp6zwqBHKmeT5XHwnAEQoKcP1WT+pFXDIli0V48olHVrt8fE+6H5Ix8Vmkn9hyboOAkBK2Znhxxovb0aJhISmNackESUtsMmhGIuZrgq22A6h4Q=="}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:39.454249 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-85187554-e535-4418-ad3f-b24d7de4ac1a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Getting quotas for project 557321bf33ca42df8d5d53e5157e6803. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:33:39.458667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-85187554-e535-4418-ad3f-b24d7de4ac1a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Getting quotas for user ae71fd7ba4334d0d813cbc0c06e3686e and project 557321bf33ca42df8d5d53e5157e6803. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:33:39.489772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-85187554-e535-4418-ad3f-b24d7de4ac1a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.056904 Oct 03 13:33:39.490392 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 182/367] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:33:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:33:39.612795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:39.626581 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-713f62b4-4e54-4a17-8868-a376ed25dc90 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1503 microversion: 2.1 time: 0.246326 Oct 03 13:33:39.627912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 186/368] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:39 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:40.109386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:40.111094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:40.122357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:40.123285 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:40.124102 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:40.125579 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:40.126581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:40.127645 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:40.322380 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:40.331713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0407414b-7829-469d-b438-75112baa52d4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.230056 Oct 03 13:33:40.332982 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 183/369] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:40 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:40.652658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:40.654155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:40.658845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:40.660327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=8 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:40.666613 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:40.667516 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:40.668178 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:40.669122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:40.669844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:40.670533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:40.688388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65727b2d-58b5-4069-8867-55191dfabd33", "device": "/dev/sdb"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:40.693930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:40.706715 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:40.707568 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:40.708347 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:40.709690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:40.710756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:40.711799 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:40.948639 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:40.961913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-170ddd9e-5a42-487d-a410-24b664323543 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1503 microversion: 2.1 time: 0.312443 Oct 03 13:33:40.963652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 187/370] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:40 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:41.222804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1888307987", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "289ad0fb-c675-48f9-ad56-9a68538f4eb7"}], "security_groups": [{"name": "tempest-securitygroup--1286502513"}], "key_name": "tempest-keypair-66205088", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:41.350497 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] validate_networks() for [('289ad0fb-c675-48f9-ad56-9a68538f4eb7', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:33:41.929655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-11450500-d0e5-4d75-8182-24f1d4e25dec tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "POST /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.248986 Oct 03 13:33:41.938372 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 184/371] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:33:40 2022] POST /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3/os-volume_attachments => generated 194 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:33:41.941956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:41.942732 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:41.951400 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:41.952362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:41.953062 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:41.954599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:41.954599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:41.955122 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:42.147065 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:33:42.147525 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:33:42.147964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:33:42.148406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:33:42.149409 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:33:42.164142 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:42.165758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:42.167452 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:42.168578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:42.169281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:42.169976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:42.173714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:42.182315 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-65ec14b9-9a34-4243-83bc-b1e0de8da6df tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.247010 Oct 03 13:33:42.183179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 185/372] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:41 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:42.187807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:42.188431 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:42.201255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:42.201789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:42.202230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:42.203011 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:42.203399 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:42.203824 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:42.213790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Getting quotas for project 557321bf33ca42df8d5d53e5157e6803. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:33:42.219582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Getting quotas for user ae71fd7ba4334d0d813cbc0c06e3686e and project 557321bf33ca42df8d5d53e5157e6803. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:33:42.235388 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:33:42.240507 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:33:42.309897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a9764693-f25b-4345-8428-e5d49c75671a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.091644 Oct 03 13:33:42.317900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 188/373] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:33:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 03 13:33:42.324372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-944ae48a-94b2-43c9-97bd-07aced5f4731 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:42.325159 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-944ae48a-94b2-43c9-97bd-07aced5f4731 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:42.336672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:42.452465 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:42.479616 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1e5cc3e4-d997-41b1-9e5f-a1eb223765c1 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1503 microversion: 2.1 time: 0.295188 Oct 03 13:33:42.480776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 186/374] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:42 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:42.501905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-944ae48a-94b2-43c9-97bd-07aced5f4731 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:42.523002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-944ae48a-94b2-43c9-97bd-07aced5f4731 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1244 microversion: 2.1 time: 0.203694 Oct 03 13:33:42.523756 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 189/375] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:42 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1244 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:43.120148 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-3a110dfd-1b97-4e7b-bda8-0e4f3ab82d16 req-8788ae2b-5771-469a-b2c4-a8997fc35443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bd9d2c-183b-420f-a839-1880c1e908da", "name": "network-vif-deleted", "tag": "f38e29f4-feb2-4591-b970-761c43afb601"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:43.131990 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-3a110dfd-1b97-4e7b-bda8-0e4f3ab82d16 req-8788ae2b-5771-469a-b2c4-a8997fc35443 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:43.132472 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-3a110dfd-1b97-4e7b-bda8-0e4f3ab82d16 req-8788ae2b-5771-469a-b2c4-a8997fc35443 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:43.132907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-3a110dfd-1b97-4e7b-bda8-0e4f3ab82d16 req-8788ae2b-5771-469a-b2c4-a8997fc35443 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:43.145592 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-3a110dfd-1b97-4e7b-bda8-0e4f3ab82d16 req-8788ae2b-5771-469a-b2c4-a8997fc35443 service nova] Creating event network-vif-deleted:f38e29f4-feb2-4591-b970-761c43afb601 for instance e8bd9d2c-183b-420f-a839-1880c1e908da on hv-cinder-86009 Oct 03 13:33:43.151905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-3a110dfd-1b97-4e7b-bda8-0e4f3ab82d16 req-8788ae2b-5771-469a-b2c4-a8997fc35443 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036073 Oct 03 13:33:43.152496 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 187/376] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:43.219241 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:43.219885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:43.227853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:43.228342 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:43.228777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:43.229521 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:43.229979 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:43.230403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:43.435713 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:43.444557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-56a9c06c-9168-49b1-94ee-c0c8bcf7448e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.229561 Oct 03 13:33:43.445366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 190/377] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:43 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:43.527044 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:43.527641 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:43.534414 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:43.534913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:43.535424 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:43.536055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:43.536511 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:43.536940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:43.547263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:43.548131 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:43.554663 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:43.555760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:43.556267 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:43.556990 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:43.557443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:43.557919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:43.578942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:43.579611 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:43.580206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:43.580741 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:43.628072 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:43.631703 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:43.638807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-eb54a051-6b7a-4174-b4de-d8a8d49346fd tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.116653 Oct 03 13:33:43.639385 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 188/378] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:43 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:43.640288 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4148f4d4-9310-4b29-94d5-f02fa6351bc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1248 microversion: 2.1 time: 0.096796 Oct 03 13:33:43.640948 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 191/379] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:43 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1248 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:44.468786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:44.469480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:44.477542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:44.478032 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:44.478473 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:44.479175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:44.479629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:44.480063 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:44.672400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:44.674200 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:44.688892 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:44.691392 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:44.692623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:44.696564 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:44.697909 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:44.699920 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:44.723759 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:44.751051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5faf7aa4-40c8-482e-af70-699ca33bad80 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.286074 Oct 03 13:33:44.756934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 189/380] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:44 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:44.767957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:44.769263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:44.782214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:44.783472 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:44.784467 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:44.786062 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:44.787188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:44.788628 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:44.811354 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:44.812382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:44.813265 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:44.814334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:44.900194 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:44.905961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:44.909669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-58e5cd33-ee07-4744-8f4b-85df1c47ecb2 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.246014 Oct 03 13:33:44.910274 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 192/381] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:44 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:44.920559 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-adfa7477-bed6-4699-9979-4f06e5ffebb7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.160265 Oct 03 13:33:44.921785 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 190/382] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:44 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:45.803209 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:45.803834 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:45.812324 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:45.812954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:45.813605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:45.814443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:45.815066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:45.815559 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:45.935792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:45.936419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:45.942858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:45.943405 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:45.943852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:45.944575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:45.945033 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:45.945601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:45.976561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:45.982163 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:45.983596 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:45.983596 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:45.984212 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:45.991437 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2f425c52-4837-419f-a130-3aa6535baab6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.191698 Oct 03 13:33:45.993416 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 193/383] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:45 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:46.001639 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:46.003113 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:46.014798 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:46.015722 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:46.016444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:46.017711 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:46.018650 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:46.019638 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:46.036279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:46.045251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8a47ea86-4cfb-4c03-865c-8cc7bfea974a tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.113607 Oct 03 13:33:46.046323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 191/384] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:45 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:46.103472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:46.112452 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-272008d1-9c2e-44bf-b784-ddf2c84589c0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.117934 Oct 03 13:33:46.113035 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 194/385] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:45 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:47.026759 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:47.027437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:47.030258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:47.036986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:47.037573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:47.038036 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:47.038781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:47.039499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:47.040072 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:47.075955 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:47.076610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:47.083830 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:47.084314 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:47.084944 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:47.085675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:47.086697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:47.087131 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:47.123741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:47.124269 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:47.124736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:47.125187 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:47.172933 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:47.181197 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-78b0525a-8112-4abf-b143-b82291b8c9c6 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.109249 Oct 03 13:33:47.181802 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 195/386] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:47 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:47.186322 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:47.186918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:47.192333 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:47.192779 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:47.193432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:47.193969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:47.194669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:47.195116 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:47.195652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:47.200447 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-94fa729e-4413-4b10-9782-8c8fbe463285 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.178600 Oct 03 13:33:47.201036 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 192/387] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:47 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:47.268803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:47.277433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b962bdfa-e701-4610-bc30-8440dfdceca2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.094544 Oct 03 13:33:47.277953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 196/388] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:47 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:48.204887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:48.205548 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:48.212800 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:48.213328 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:48.213801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:48.214562 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:48.215059 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:48.215487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:48.224408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:48.225098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:48.232906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:48.233402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:48.233897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:48.234769 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:48.235231 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:48.235660 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:48.237081 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:48.258334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:48.258838 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:48.259289 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:48.259760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:48.307405 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:48.315800 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-392d9b35-0eb8-49f7-bcc9-fa0ae831c0aa tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.114722 Oct 03 13:33:48.316489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 193/389] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:48 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:48.321615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:48.322242 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:48.328585 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:48.329128 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:48.331875 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:48.332719 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:48.333198 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:48.333678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:48.390577 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:48.396862 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:48.399429 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-de07f581-ba2a-4eff-be68-3ecb941d4c83 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.178772 Oct 03 13:33:48.400309 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 197/390] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:48 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:48.405628 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-61986485-2559-473e-838e-742b38b0645f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.087992 Oct 03 13:33:48.406214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 194/391] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:48 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:49.342636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:49.343801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:49.350461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:49.350959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:49.351406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:49.352913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:49.353574 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:49.354008 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:49.392820 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:49.393315 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:49.393782 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:49.394236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:49.428861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:49.429760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:49.439649 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:49.441140 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:49.442450 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:49.443635 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:49.444379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:49.445088 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:49.454157 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:49.466788 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ee3cfff2-1a78-436e-a7f5-29ea929e79c5 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.127987 Oct 03 13:33:49.467494 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:49.480631 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 198/392] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:49 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:49.480631 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:49.480631 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:49.481370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:49.485419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:49.485419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:49.485419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:49.485419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:49.485864 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:49.527078 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:49.540888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-416991c6-fdd6-4cc5-9748-bb51b7e8a96b tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.115442 Oct 03 13:33:49.542034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 195/393] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:49 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:49.647084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:49.654886 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4a271a86-c6e7-49a1-9312-4a2fb74e875f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.186049 Oct 03 13:33:49.655446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 199/394] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:49 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:50.493903 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:50.494549 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:50.501809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:50.502573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:50.503029 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:50.503737 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:50.504199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:50.504625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:50.545006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:50.545534 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:50.546025 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:50.546475 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:50.571021 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:50.574646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:50.583994 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:50.584888 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:50.585716 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:50.587731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:50.588652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:50.589383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:50.609308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:50.622037 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f1656045-1177-48a1-aa3b-818ab0dcfaaf tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.132528 Oct 03 13:33:50.622817 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 196/395] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:50 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:50.672555 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:50.681151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3f64aeb7-053d-48b8-b1be-4dd44372f2f2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.118250 Oct 03 13:33:50.681767 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 200/396] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:50 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:50.683182 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:50.683808 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:50.689878 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:50.690368 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:50.690821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:50.691517 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:50.691984 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:50.692409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:50.839353 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:50.847261 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-df0d5a61-1122-44e7-adf3-2db8a86fe73b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.168703 Oct 03 13:33:50.847853 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 197/397] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:50 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:51.645852 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:51.646602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:51.653205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:51.653729 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:51.654169 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:51.654859 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:51.655313 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:51.655736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:51.693362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:51.693976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:51.694414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:51.694868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:51.697553 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:51.707384 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:51.708215 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:51.716570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:51.717186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:51.717737 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:51.718565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:51.719170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:51.719602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:51.742721 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:51.751775 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ef4b69b3-8c2f-48d6-b65c-f090237c440d tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.109678 Oct 03 13:33:51.752827 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 201/398] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:51 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:51.798015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:51.806957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-464cdcdd-0c35-44b2-8c28-f4f8e37d1d9f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.105536 Oct 03 13:33:51.807674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 198/399] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:51 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:51.871433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:51.872040 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:51.878799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:51.879275 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:51.879709 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:51.880393 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:51.880837 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:51.881253 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:52.023086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:52.031649 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-268c9eec-8cbb-41ea-bc26-8e062f7e9d15 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.164534 Oct 03 13:33:52.032242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 202/400] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:51 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:52.776620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:52.777218 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:52.783857 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:52.784336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:52.784770 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:52.785471 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:52.785932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:52.786352 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:52.830409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:52.830894 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:52.831329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:52.831856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:52.832929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:52.833730 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:52.836082 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:52.836991 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=8 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:33:52.847118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:52.847975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:52.848919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:52.850161 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:52.850995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:52.851744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:52.885625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:52.893633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0be30afd-c638-49cc-a91b-e22aaec1c87e tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.121577 Oct 03 13:33:52.894212 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 199/401] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:52 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:52.922445 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:52.930393 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4dc9fd5c-e9a8-4c9f-a230-5d54d519da00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.102950 Oct 03 13:33:52.931038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 203/402] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:52 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:53.056379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:53.056953 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:53.063707 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:53.064191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:53.064627 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:53.065327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:53.065803 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:53.066275 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:53.237905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:53.247422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9b6fdc90-0464-4e54-a7d0-378be544e60b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.195354 Oct 03 13:33:53.248019 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 200/403] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:53 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:53.917654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:53.918280 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:53.924596 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:53.925078 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:53.925540 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:53.926236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:53.926700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:53.927126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:53.953638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:53.954260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:53.957934 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:53.958461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:53.961900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:53.961900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lazy-loading 'fault' on Instance uuid e8bd9d2c-183b-420f-a839-1880c1e908da {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:33:53.964772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:53.965271 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:53.965749 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:53.966462 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:53.966932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:53.967400 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:54.018190 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b293568e74c4c69baee5cb29013ab6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa1958afb874a0cba4c57df10f2ce08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:54.028565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-edae72bd-1361-4702-b343-e4b07d9ae72b tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 200 len: 1304 microversion: 2.1 time: 0.115484 Oct 03 13:33:54.029975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 204/404] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:53 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:54.076110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:54.093897 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3fe5cdf6-a8cf-4091-86b7-4231269a1ab2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1240 microversion: 2.1 time: 0.142491 Oct 03 13:33:54.095249 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 201/405] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:53 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1240 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:33:54.272262 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:54.272931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:54.281696 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:54.282416 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:54.282858 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:54.283562 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:54.284017 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:54.284437 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:54.490210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:54.500281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-16109439-0d30-40c2-a398-ba62bd69e452 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.232217 Oct 03 13:33:54.500852 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 205/406] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:54 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:54.981629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-ebdb29ed-ed7d-482f-9806-1209f0603a38 req-d946d352-daf9-4e72-b6a1-6084ae28f324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1530d3cd-a03d-4ccc-bf56-064b83e978c8", "name": "network-vif-plugged", "status": "completed", "tag": "fb7024a0-6b02-454f-ba31-1290a4622c59"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:54.996748 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ebdb29ed-ed7d-482f-9806-1209f0603a38 req-d946d352-daf9-4e72-b6a1-6084ae28f324 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:54.997235 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ebdb29ed-ed7d-482f-9806-1209f0603a38 req-d946d352-daf9-4e72-b6a1-6084ae28f324 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:54.998114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ebdb29ed-ed7d-482f-9806-1209f0603a38 req-d946d352-daf9-4e72-b6a1-6084ae28f324 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:55.012636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-ebdb29ed-ed7d-482f-9806-1209f0603a38 req-d946d352-daf9-4e72-b6a1-6084ae28f324 service nova] Creating event network-vif-plugged:fb7024a0-6b02-454f-ba31-1290a4622c59 for instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 on hv-cinder-86009 Oct 03 13:33:55.019019 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-ebdb29ed-ed7d-482f-9806-1209f0603a38 req-d946d352-daf9-4e72-b6a1-6084ae28f324 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043574 Oct 03 13:33:55.020566 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 202/407] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:55.058969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:55.059708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] [instance: e8bd9d2c-183b-420f-a839-1880c1e908da] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:55.067614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:55.068090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:55.068517 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:55.069430 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:55.069902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:55.070318 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:55.090629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] HTTP exception thrown: Instance e8bd9d2c-183b-420f-a839-1880c1e908da could not be found. Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Request method failure captured: Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da HTTP/1.1 Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuR4qUegOxglj9_5TQQ-w0atzGMJEi2mj-cqvzGkRN0CD4WfReEovFQMoQZv6dZzE27VbXKqur7VJ2VajRGYvZCJwDzo69LXZ-r-H1s0NDTPrZyqfBJNFmRxJYJ1JhgEjIpJqOh2TLBZCp8tIuBRxoSl7YJg_cWk23cZaZVScXJJ-sA Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: afa1958afb874a0cba4c57df10f2ce08 Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesActionsTest-2129919452 Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:33:55.093400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/afa1958afb874a0cba4c57df10f2ce08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/afa1958afb874a0cba4c57df10f2ce08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_afa1958afb874a0cba4c57df10f2ce08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/afa1958afb874a0cba4c57df10f2ce08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesActionsTest-2129919452 Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: afa1958afb874a0cba4c57df10f2ce08 Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesActionsTest-2129919452 Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesActionsTest-2129919452-project Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 9b293568e74c4c69baee5cb29013ab6d Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesActionsTest-2129919452-project Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance e8bd9d2c-183b-420f-a839-1880c1e908da could not be found. Oct 03 13:33:55.094854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'e8bd9d2c-183b-420f-a839-1880c1e908da'} Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8bd9d2c-183b-420f-a839-1880c1e908da could not be found. Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:33:55.095610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8bd9d2c-183b-420f-a839-1880c1e908da could not be found. Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8bd9d2c-183b-420f-a839-1880c1e908da could not be found. Oct 03 13:33:55.096900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:33:55.098071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] Returning 404 to user: Instance e8bd9d2c-183b-420f-a839-1880c1e908da could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:33:55.098071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-138048b6-8dd1-499b-a74d-729374b80f59 tempest-VolumesActionsTest-2129919452 tempest-VolumesActionsTest-2129919452-project] 10.222.0.58 "GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da" status: 404 len: 111 microversion: 2.1 time: 0.042328 Oct 03 13:33:55.098071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 206/408] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:55 2022] GET /compute/v2.1/servers/e8bd9d2c-183b-420f-a839-1880c1e908da => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:33:55.119819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:55.121153 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:55.130273 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:55.131937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:55.132895 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:55.142158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:55.142972 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:55.143500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:55.253539 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:55.267055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-37041a47-4e79-44af-aa21-6ba25bd10709 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1304 microversion: 2.1 time: 0.152076 Oct 03 13:33:55.276228 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 203/409] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:55 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:55.525205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:55.526318 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:55.533330 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:55.533905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:55.534354 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:55.535141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:55.535599 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:55.536214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:55.779557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:55.800256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6044a210-3c35-4a33-81d8-f594f5b0acc0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.279408 Oct 03 13:33:55.806692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 207/410] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:55 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:56.297424 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:56.298095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:56.304852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:56.305346 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:56.306356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:56.307080 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:56.307817 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:56.308253 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:56.475002 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:56.483842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d773f0ad-2599-4ed9-844a-8055cefb4e12 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.190295 Oct 03 13:33:56.484743 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 204/411] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:56 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:56.825382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:56.826176 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:56.833536 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:56.834032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:56.834469 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:56.835184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:56.835641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:56.836065 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:56.980929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:56.989361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c9c6645b-8dc1-486f-89c8-bc0e8d266d2e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.168608 Oct 03 13:33:56.989959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 208/412] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:56 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:57.509379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:57.509950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:57.516470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:57.516948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:57.517386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:57.518108 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:57.518557 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:57.518978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:57.654866 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:57.662649 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-96f9c044-d397-47ac-80de-6b375f8ef9c5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.157288 Oct 03 13:33:57.663219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 205/413] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:57 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:58.014907 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:58.015506 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:58.022080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:58.022563 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:58.022997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:58.023695 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:58.024150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:58.025409 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:58.161408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:58.172636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d2f2d1ef-540d-4c44-87a0-e304443adcbd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.161503 Oct 03 13:33:58.173231 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 209/414] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:58 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:58.686506 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:58.687134 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:58.693688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:58.694176 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:58.694620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:58.695317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:58.695774 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:58.696214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:58.834268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:58.842448 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6eb5d8e6-a7e8-4159-a797-e01a7ffb44d6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.160501 Oct 03 13:33:58.842945 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 206/415] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:58 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:59.195832 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:59.196435 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:59.203560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:59.204047 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:59.204478 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:59.205169 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:59.205657 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:59.206076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:59.426873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:33:59.435606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-026091c9-a190-444f-9fd0-049995cbe98c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.243613 Oct 03 13:33:59.436313 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 210/416] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:59 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:33:59.766091 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-f53e3a0e-bc9d-44dd-a643-51e0c593f71c req-1511a5d4-6a9a-49f8-9b38-888586f75e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959d25e3-1620-4fb7-836c-7d55711fda46", "tag": "c4c1e4cd-a186-476e-9685-648d091500db"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:33:59.776201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-f53e3a0e-bc9d-44dd-a643-51e0c593f71c req-1511a5d4-6a9a-49f8-9b38-888586f75e7a service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:59.776841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-f53e3a0e-bc9d-44dd-a643-51e0c593f71c req-1511a5d4-6a9a-49f8-9b38-888586f75e7a service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:59.777275 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-f53e3a0e-bc9d-44dd-a643-51e0c593f71c req-1511a5d4-6a9a-49f8-9b38-888586f75e7a service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:59.788112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-f53e3a0e-bc9d-44dd-a643-51e0c593f71c req-1511a5d4-6a9a-49f8-9b38-888586f75e7a service nova] Creating event network-changed:c4c1e4cd-a186-476e-9685-648d091500db for instance 959d25e3-1620-4fb7-836c-7d55711fda46 on hv-cinder-86009 Oct 03 13:33:59.793730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-f53e3a0e-bc9d-44dd-a643-51e0c593f71c req-1511a5d4-6a9a-49f8-9b38-888586f75e7a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031481 Oct 03 13:33:59.794338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 207/417] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:33:59.866406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:33:59.867012 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:33:59.873507 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:59.873983 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:59.874415 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:33:59.875105 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:33:59.875537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:33:59.875957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:00.009122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:00.017377 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-18a90be9-e599-4803-b639-e631fd3a2a73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.154777 Oct 03 13:34:00.018284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 211/418] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:33:59 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:00.459891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:00.460601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:00.467417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:00.467908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:00.468354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:00.469050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:00.469536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:00.469973 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:00.611560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:00.619520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0dd465e6-b287-4451-94d5-4f96d9067962 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.163794 Oct 03 13:34:00.620158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 208/419] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:00 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:01.041002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:01.041644 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:01.051579 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:01.052069 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:01.052507 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:01.053204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:01.053687 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:01.054115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:01.187358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:01.195026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e45f0581-936e-414b-8a4e-a70b3d954a97 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.157890 Oct 03 13:34:01.195601 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 212/420] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:01 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:01.642316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:01.642858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:01.649212 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:01.649742 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:01.650183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:01.650865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:01.651321 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:01.651747 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:01.792730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:01.800601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-74d6bb47-08b0-4b0d-884a-ffb607ae1fa2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.162193 Oct 03 13:34:01.801168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 209/421] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:01 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:02.218999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:02.219610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:02.226083 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:02.226566 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:02.227002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:02.227694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:02.228146 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:02.228565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:02.359367 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:02.366634 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0b569f09-c2ba-4ce7-afc6-06e155b25764 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.151498 Oct 03 13:34:02.367201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 213/422] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:02 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:02.824203 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:02.824969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:02.831961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:02.832461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:02.832902 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:02.833635 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:02.834164 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:02.834620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:02.850851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=100 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:02.968481 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:02.976502 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-80bcf98e-3b6d-4e22-876f-4b29eaa0d141 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.156740 Oct 03 13:34:02.977082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 210/423] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:02 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:34:03.389794 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:03.390401 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:03.397208 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:03.397728 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:03.398164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:03.398850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:03.399303 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:03.399728 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:03.609640 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:03.618453 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d2349a09-b245-4954-837b-d78695711e00 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.232233 Oct 03 13:34:03.619019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 214/424] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:03 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:03.999855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:04.000475 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:04.007224 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:04.007718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:04.008160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:04.008855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:04.009382 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:04.009775 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:04.143491 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:04.152235 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0d3608be-bada-4312-ae48-4945955be186 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1368 microversion: 2.1 time: 0.156201 Oct 03 13:34:04.152832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 211/425] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:03 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:04.642912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:04.643454 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:04.649924 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:04.650403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:04.650838 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:04.651524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:04.651976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:04.652398 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:04.810784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:04.818623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6ee76c8a-f379-4552-96ba-720bdc42955d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.179679 Oct 03 13:34:04.819201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 215/426] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:04 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:05.177040 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:05.178065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:05.191097 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:05.191622 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:05.192067 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:05.192803 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:05.193258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:05.193737 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:05.358648 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:05.367663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8260b055-787d-4833-9a24-f4759365ab6c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1557 microversion: 2.1 time: 0.195443 Oct 03 13:34:05.368251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 212/427] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:05 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:05.394453 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:05.394995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:05.405670 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:05.406050 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:05.406734 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:05.407780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:05.408346 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:05.409033 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:05.545299 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fab31768-cdce-45e4-ae2e-7525264a3b01 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155011 Oct 03 13:34:05.546696 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 216/428] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 3 13:34:05 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:34:05.841841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:05.842388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:05.848751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:05.849689 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:05.850221 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:05.851209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:05.851944 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:05.852642 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:06.014703 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:06.027358 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a80f4750-36db-417c-a2d9-edefa11d7448 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.189639 Oct 03 13:34:06.028277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 213/429] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:05 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:06.151543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:06.152770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:06.160569 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:06.161724 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:06.161724 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:06.162513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:06.163144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:06.163884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:06.343745 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lazy-loading 'services' on Instance uuid 020a908b-0c09-4a49-9482-62d085fd1df3 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:34:06.490815 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-61eeef27-cad9-46ac-92f1-e482127c0402 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "DELETE /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3/os-volume_attachments/65727b2d-58b5-4069-8867-55191dfabd33" status: 202 len: 0 microversion: 2.1 time: 0.342853 Oct 03 13:34:06.491471 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 217/430] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:34:06 2022] DELETE /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3/os-volume_attachments/65727b2d-58b5-4069-8867-55191dfabd33 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:34:06.751422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-70ca0e89-d1fa-4e42-bb41-f24a5ba41dba req-d96e0040-0f75-4251-be81-083be84c4ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1530d3cd-a03d-4ccc-bf56-064b83e978c8", "tag": "fb7024a0-6b02-454f-ba31-1290a4622c59"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:06.762755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-70ca0e89-d1fa-4e42-bb41-f24a5ba41dba req-d96e0040-0f75-4251-be81-083be84c4ead service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:06.763324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-70ca0e89-d1fa-4e42-bb41-f24a5ba41dba req-d96e0040-0f75-4251-be81-083be84c4ead service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:06.763952 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-70ca0e89-d1fa-4e42-bb41-f24a5ba41dba req-d96e0040-0f75-4251-be81-083be84c4ead service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:06.777059 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-70ca0e89-d1fa-4e42-bb41-f24a5ba41dba req-d96e0040-0f75-4251-be81-083be84c4ead service nova] Creating event network-changed:fb7024a0-6b02-454f-ba31-1290a4622c59 for instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 on hv-cinder-86009 Oct 03 13:34:06.784687 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-70ca0e89-d1fa-4e42-bb41-f24a5ba41dba req-d96e0040-0f75-4251-be81-083be84c4ead service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037025 Oct 03 13:34:06.785640 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 214/431] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:34:07.057199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:07.058052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:07.066480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:07.067635 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:07.068042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:07.068845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:07.069564 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:07.069964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:07.074965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:07.266285 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:07.277086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-46acc2f3-92da-4e94-9169-49edd1d2462f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.224275 Oct 03 13:34:07.294697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 218/432] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:07 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:08.307008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:08.307885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:08.316931 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:08.317892 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:08.318764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:08.319838 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:08.320688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:08.321198 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:08.776484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:08.786572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ee3e81f7-584f-4830-bd55-8f97f9344c83 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.485071 Oct 03 13:34:08.798254 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 215/433] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:08 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:09.814901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:09.816980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:09.844337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:09.846386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:09.847057 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:09.847966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:09.848585 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:09.849247 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:09.850414 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:09.851327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:09.859678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:09.860470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:09.861022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:09.861883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:09.862595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:09.863602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:09.897281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:34:10.078594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-94bae133-5fe1-43c9-8b7f-4f66b80e913d tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "DELETE /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 204 len: 0 microversion: 2.1 time: 0.233835 Oct 03 13:34:10.081246 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 216/434] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:34:09 2022] DELETE /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:34:10.103095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:10.106735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:10.120509 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:10.122513 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:10.124312 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:10.126224 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:10.127395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:10.128104 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:10.213146 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:10.229878 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6d332257-5860-4eb0-a61a-d18df034cc02 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.420892 Oct 03 13:34:10.252748 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 219/435] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:09 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:10.342508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:10.358735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1b95f3d8-0d78-4d5d-a3b3-62439595b5f9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1514 microversion: 2.1 time: 0.270733 Oct 03 13:34:10.366199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 217/436] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:10 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:34:11.260773 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:11.261401 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:11.269328 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:11.269968 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:11.270639 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:11.271459 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:11.271843 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:11.272262 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:11.392761 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:11.393849 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:11.410681 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:11.411786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:11.412864 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:11.413874 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:11.414777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:11.416031 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:11.531466 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:11.539965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bd0e5913-d32d-4f54-aa2e-622a12fb28cc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.283426 Oct 03 13:34:11.540874 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 220/437] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:11 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:11.584578 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:11.593638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8550dc33-30d4-4a72-92cb-7671752c8791 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1514 microversion: 2.1 time: 0.209500 Oct 03 13:34:11.594823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 218/438] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:11 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:11.874727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-ed90f42b-c7af-42ad-9791-8e49612c39b4 req-f1e22b72-0124-4611-846e-4963809c332c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959d25e3-1620-4fb7-836c-7d55711fda46", "name": "network-vif-plugged", "status": "completed", "tag": "c4c1e4cd-a186-476e-9685-648d091500db"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:11.885228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ed90f42b-c7af-42ad-9791-8e49612c39b4 req-f1e22b72-0124-4611-846e-4963809c332c service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:11.885744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ed90f42b-c7af-42ad-9791-8e49612c39b4 req-f1e22b72-0124-4611-846e-4963809c332c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:11.886177 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ed90f42b-c7af-42ad-9791-8e49612c39b4 req-f1e22b72-0124-4611-846e-4963809c332c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:11.899669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-ed90f42b-c7af-42ad-9791-8e49612c39b4 req-f1e22b72-0124-4611-846e-4963809c332c service nova] Creating event network-vif-plugged:c4c1e4cd-a186-476e-9685-648d091500db for instance 959d25e3-1620-4fb7-836c-7d55711fda46 on hv-cinder-86009 Oct 03 13:34:11.905385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-ed90f42b-c7af-42ad-9791-8e49612c39b4 req-f1e22b72-0124-4611-846e-4963809c332c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035308 Oct 03 13:34:11.906467 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 221/439] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:34:12.570160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:12.570880 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:12.578109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:12.579046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:12.579572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:12.580596 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:12.581142 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:12.581674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:12.620389 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:12.620988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:12.623816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=76 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:12.629805 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:12.630295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:12.630757 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:12.631459 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:12.631912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:12.632341 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:12.735695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:12.745197 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d72adbf5-b26f-4b12-8f59-8de248f64cb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.179018 Oct 03 13:34:12.749516 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 219/440] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:12 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:12.820821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:12.829820 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-826c32a1-f79b-4572-9d99-0b42c4e88dbb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1514 microversion: 2.1 time: 0.214068 Oct 03 13:34:12.830421 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 222/441] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:12 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:13.782716 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:13.782716 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:13.796296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:13.796950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:13.797440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:13.798663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:13.798663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:13.798663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:13.854593 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:13.856897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:13.868693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:13.869938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:13.870638 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:13.871721 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:13.872688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:13.873950 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:13.972077 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:13.981522 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c5a86661-8e47-4a12-b3cb-bd4ec4fe9bb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.211241 Oct 03 13:34:13.982513 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 220/442] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:13 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:14.087096 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:14.099422 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9f03aed1-3498-4996-a4df-faada6e98e02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1514 microversion: 2.1 time: 0.249450 Oct 03 13:34:14.100362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 223/443] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:13 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:14.815852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-2c8e4da5-0891-4bd0-8a56-8a85e64722d6 req-4e5b701d-844a-4cc2-ade0-e987bb556dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020a908b-0c09-4a49-9482-62d085fd1df3", "name": "network-vif-deleted", "tag": "bfaafb6c-9eba-4966-9079-4cc52951697a"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:14.827928 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-2c8e4da5-0891-4bd0-8a56-8a85e64722d6 req-4e5b701d-844a-4cc2-ade0-e987bb556dcb service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:14.828700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-2c8e4da5-0891-4bd0-8a56-8a85e64722d6 req-4e5b701d-844a-4cc2-ade0-e987bb556dcb service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:14.829324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-2c8e4da5-0891-4bd0-8a56-8a85e64722d6 req-4e5b701d-844a-4cc2-ade0-e987bb556dcb service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:14.843272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-2c8e4da5-0891-4bd0-8a56-8a85e64722d6 req-4e5b701d-844a-4cc2-ade0-e987bb556dcb service nova] Creating event network-vif-deleted:bfaafb6c-9eba-4966-9079-4cc52951697a for instance 020a908b-0c09-4a49-9482-62d085fd1df3 on hv-cinder-86009 Oct 03 13:34:14.848714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-2c8e4da5-0891-4bd0-8a56-8a85e64722d6 req-4e5b701d-844a-4cc2-ade0-e987bb556dcb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Oct 03 13:34:14.849436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 221/444] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:34:15.010550 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:15.011347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:15.022808 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:15.024168 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:15.024955 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:15.026723 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:15.027681 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:15.028278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:15.131617 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:15.132794 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:15.141578 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:15.142418 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:15.143148 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:15.143937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:15.144629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:15.145314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:15.222545 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:15.224833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:15.234340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a4baf7c5-8f8a-4839-a0d4-4a9883680b02 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1472 microversion: 2.1 time: 0.107704 Oct 03 13:34:15.249480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 222/445] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:15 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1472 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:15.249735 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-11807e60-1e78-48ab-84d9-92643bab1715 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1370 microversion: 2.1 time: 0.235642 Oct 03 13:34:15.251480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 224/446] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:15 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:16.259290 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:16.260041 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:16.268884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:16.269486 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:16.269940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:16.270654 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:16.272397 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:16.272397 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:16.279890 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:16.282456 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:16.297047 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:16.300623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:16.301161 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:16.301936 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:16.302703 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:16.303349 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:16.320802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:16.322022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:16.322486 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:16.323482 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lazy-loading 'fault' on Instance uuid 020a908b-0c09-4a49-9482-62d085fd1df3 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:34:16.396638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:16.408827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f94f1ce5-b9ed-47ff-bbce-ff49e9309afb tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1309 microversion: 2.1 time: 0.153695 Oct 03 13:34:16.409729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 223/447] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:16 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:34:16.473885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:16.482919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6d7de9d0-5fac-4c5d-b5c6-94d0beecbb21 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1564 microversion: 2.1 time: 0.209024 Oct 03 13:34:16.497860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 225/448] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:16 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1564 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:16.508797 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:16.509321 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:16.517895 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:16.518739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:16.519385 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:16.520357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:16.521004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:16.521768 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:16.621765 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a10fb086-d5bb-4c2d-99f3-acfd62b1b5ea tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117006 Oct 03 13:34:16.622453 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 224/449] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 3 13:34:16 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:34:17.435294 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:17.436661 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:17.443615 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:17.444378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:17.445153 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:17.446167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:17.446776 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:17.447356 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:17.527318 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:17.528891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:17.529720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:17.530355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lazy-loading 'fault' on Instance uuid 020a908b-0c09-4a49-9482-62d085fd1df3 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:34:17.868204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:17.885580 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-793868a0-1754-4a53-a43b-246bdb2bd668 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 200 len: 1309 microversion: 2.1 time: 0.454707 Oct 03 13:34:17.888110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 226/450] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:17 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 1309 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:18.072223 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-e525bb3e-e9d3-4b20-abd9-5acf90f0715a req-74e0b05a-a5f2-4806-b96e-19e17f62c301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959d25e3-1620-4fb7-836c-7d55711fda46", "tag": "c4c1e4cd-a186-476e-9685-648d091500db"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:18.082061 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:18.084640 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e525bb3e-e9d3-4b20-abd9-5acf90f0715a req-74e0b05a-a5f2-4806-b96e-19e17f62c301 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:18.085311 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e525bb3e-e9d3-4b20-abd9-5acf90f0715a req-74e0b05a-a5f2-4806-b96e-19e17f62c301 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:18.085960 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e525bb3e-e9d3-4b20-abd9-5acf90f0715a req-74e0b05a-a5f2-4806-b96e-19e17f62c301 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:18.100054 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-e525bb3e-e9d3-4b20-abd9-5acf90f0715a req-74e0b05a-a5f2-4806-b96e-19e17f62c301 service nova] Creating event network-changed:c4c1e4cd-a186-476e-9685-648d091500db for instance 959d25e3-1620-4fb7-836c-7d55711fda46 on hv-cinder-86009 Oct 03 13:34:18.106551 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-e525bb3e-e9d3-4b20-abd9-5acf90f0715a req-74e0b05a-a5f2-4806-b96e-19e17f62c301 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038013 Oct 03 13:34:18.107166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 225/451] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:34:18.913114 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:18.914038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 020a908b-0c09-4a49-9482-62d085fd1df3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:18.928746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:18.929272 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:18.929742 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:18.930473 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:18.930933 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:18.931362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:18.961393 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] HTTP exception thrown: Instance 020a908b-0c09-4a49-9482-62d085fd1df3 could not be found. Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Request method failure captured: Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 HTTP/1.1 Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuSBd50mGHrjL8Ok6lrph9KaIGUzAtsqgIP-fcpaOsgtvVYZPPkbntH-kNkcAj95zwt7lNwJ84moZjd8PkIJPW6EbepDb81Js8PV0BBx293ArZn4m6c2N31hTmu73_BDfgUULyWfSr8o9zZbi07-sPbyW5r9OANya58Wu7LqPoTM-Bc Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 33af9400d270489da18c21dee3f9188f Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesSnapshotTestJSON-986009736 Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:34:18.963195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33af9400d270489da18c21dee3f9188f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33af9400d270489da18c21dee3f9188f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33af9400d270489da18c21dee3f9188f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33af9400d270489da18c21dee3f9188f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesSnapshotTestJSON-986009736 Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 33af9400d270489da18c21dee3f9188f Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-986009736 Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesSnapshotTestJSON-986009736-project Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 75e5a47c5b314a0486d3a32ffbead793 Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesSnapshotTestJSON-986009736-project Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 020a908b-0c09-4a49-9482-62d085fd1df3 could not be found. Oct 03 13:34:18.965115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '020a908b-0c09-4a49-9482-62d085fd1df3'} Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 020a908b-0c09-4a49-9482-62d085fd1df3 could not be found. Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:34:18.966149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 020a908b-0c09-4a49-9482-62d085fd1df3 could not be found. Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 020a908b-0c09-4a49-9482-62d085fd1df3 could not be found. Oct 03 13:34:18.967362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:34:18.968468 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Returning 404 to user: Instance 020a908b-0c09-4a49-9482-62d085fd1df3 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:34:18.968468 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ac068af4-1e00-4588-9686-612fdf3abc14 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3" status: 404 len: 111 microversion: 2.1 time: 0.055609 Oct 03 13:34:18.981477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 227/452] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:18 2022] GET /compute/v2.1/servers/020a908b-0c09-4a49-9482-62d085fd1df3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:34:31.220731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:31.221487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:31.225637 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-698211277", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "networks": [{"uuid": "e099c20e-064c-44a9-b92e-4dc5aecf03f8"}]}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:31.283496 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] validate_networks() for [('e099c20e-064c-44a9-b92e-4dc5aecf03f8', None, None, None, None, None)] {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:34:31.674929 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:34:31.675359 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:34:31.675867 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:34:31.676281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:34:31.676696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:34:31.686692 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:31.687148 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:31.687670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:31.688311 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:31.688767 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:31.689193 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:31.708627 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Getting quotas for project 33af9400d270489da18c21dee3f9188f. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:34:31.713244 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Getting quotas for user 75e5a47c5b314a0486d3a32ffbead793 and project 33af9400d270489da18c21dee3f9188f. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:34:31.727407 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:34:31.730272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:34:31.782632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5c7cd5dc-d138-4d5c-b9e8-bc4c6445e478 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563209 Oct 03 13:34:31.783066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 226/453] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:34:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:34:31.799702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-55d6c34e-9cd6-4b0c-964b-1c9f916b47bd tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:31.800606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-55d6c34e-9cd6-4b0c-964b-1c9f916b47bd tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:31.806302 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=13 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:31.807406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=53 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:31.861981 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-55d6c34e-9cd6-4b0c-964b-1c9f916b47bd tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:31.869795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-55d6c34e-9cd6-4b0c-964b-1c9f916b47bd tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1218 microversion: 2.1 time: 0.073683 Oct 03 13:34:31.870641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 228/454] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:31 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:32.909955 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:32.910560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:32.919196 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:32.919606 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:32.920044 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:32.920745 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:32.921195 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:32.921660 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:32.987848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:32.997011 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-684f4d57-8f91-4d1d-9d0c-359e92414cd8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1270 microversion: 2.1 time: 0.091295 Oct 03 13:34:32.997723 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 227/455] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:32 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:34.021594 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:34.022210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:34.030170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:34.030170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:34.030561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:34.031268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:34.031728 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:34.032154 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:34.152500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:34.161206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6aba17e3-c840-4477-b2c2-e6957e7bb6a4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1276 microversion: 2.1 time: 0.143559 Oct 03 13:34:34.161737 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 229/456] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:34 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:35.186231 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:35.187140 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:35.193870 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:35.194605 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:35.195229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:35.196309 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:35.197257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:35.197863 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:35.365979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:35.392963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3909dba4-2d3d-4387-b550-ab4e97898a61 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.210847 Oct 03 13:34:35.393782 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 228/457] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:35 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:35.645017 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-96719073-c0d9-443e-9c44-8b70499da22e req-f649ca67-d12e-4815-ab9c-159a8e2bfd4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b97156c-d1de-4e9e-9356-ab4510c0c633", "tag": "96970edd-6135-4b48-bcb5-acaaa6b38d2b"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:35.657440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-96719073-c0d9-443e-9c44-8b70499da22e req-f649ca67-d12e-4815-ab9c-159a8e2bfd4c service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:35.657954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-96719073-c0d9-443e-9c44-8b70499da22e req-f649ca67-d12e-4815-ab9c-159a8e2bfd4c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:35.658379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-96719073-c0d9-443e-9c44-8b70499da22e req-f649ca67-d12e-4815-ab9c-159a8e2bfd4c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:35.671171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-96719073-c0d9-443e-9c44-8b70499da22e req-f649ca67-d12e-4815-ab9c-159a8e2bfd4c service nova] Creating event network-changed:96970edd-6135-4b48-bcb5-acaaa6b38d2b for instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 on hv-cinder-86009 Oct 03 13:34:35.677217 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-96719073-c0d9-443e-9c44-8b70499da22e req-f649ca67-d12e-4815-ab9c-159a8e2bfd4c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037086 Oct 03 13:34:35.678050 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 230/458] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:34:36.418316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:36.419160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:36.429845 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:36.430820 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:36.431734 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:36.433376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:36.434189 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:36.434700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:36.645488 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:36.655564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e554d923-7deb-45d4-8cd4-03685964629f tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.242679 Oct 03 13:34:36.656504 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 229/459] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:36 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:34:37.680282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:37.680998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:37.688713 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:37.689211 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:37.689692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:37.690408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:37.690863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:37.691288 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:37.870494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:37.878661 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da9f1ffd-cf5a-4211-af92-4f6bf7c77551 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.202610 Oct 03 13:34:37.879240 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 231/460] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:37 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:38.908599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:38.910026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:38.918424 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:38.918932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:38.919381 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:38.920110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:38.920566 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:38.920998 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:39.118296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:39.133965 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9af899a6-e660-492c-949e-b0dff170aed4 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.234377 Oct 03 13:34:39.134894 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 230/461] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:38 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:40.167857 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:40.168842 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:40.175613 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:40.176110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:40.176549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:40.177271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:40.177764 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:40.178200 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:40.339037 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:40.346706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0fb6d41e-d238-4561-9ee6-daf2af856ecc tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.182910 Oct 03 13:34:40.347303 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 232/462] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:40 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:41.371314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:41.371943 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:41.379386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:41.379876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:41.380322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:41.381036 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:41.381526 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:41.381963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:41.535710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:41.545239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1d55732a-69ca-4f6c-8835-c16f3c1287cf tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.178382 Oct 03 13:34:41.545899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 231/463] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:41 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:34:42.128319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-5844c567-0a83-40c0-bff8-7a6968ffd942 req-f8bf7d80-cfcc-4cc6-976e-10331fcbb728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b97156c-d1de-4e9e-9356-ab4510c0c633", "name": "network-vif-plugged", "status": "completed", "tag": "96970edd-6135-4b48-bcb5-acaaa6b38d2b"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:42.136503 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:42.143492 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5844c567-0a83-40c0-bff8-7a6968ffd942 req-f8bf7d80-cfcc-4cc6-976e-10331fcbb728 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:42.144002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5844c567-0a83-40c0-bff8-7a6968ffd942 req-f8bf7d80-cfcc-4cc6-976e-10331fcbb728 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:42.144436 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5844c567-0a83-40c0-bff8-7a6968ffd942 req-f8bf7d80-cfcc-4cc6-976e-10331fcbb728 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:42.156482 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-5844c567-0a83-40c0-bff8-7a6968ffd942 req-f8bf7d80-cfcc-4cc6-976e-10331fcbb728 service nova] Creating event network-vif-plugged:96970edd-6135-4b48-bcb5-acaaa6b38d2b for instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 on hv-cinder-86009 Oct 03 13:34:42.163468 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-5844c567-0a83-40c0-bff8-7a6968ffd942 req-f8bf7d80-cfcc-4cc6-976e-10331fcbb728 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040200 Oct 03 13:34:42.164264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 233/464] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:34:42.583773 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:42.584662 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:42.586636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:42.587304 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=6 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:34:42.596946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:42.597441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:42.598776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:42.599499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:42.600755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:42.601194 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:42.744762 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:42.753950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9f491a8a-339a-46cc-99c6-9453f6f12b87 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.174187 Oct 03 13:34:42.754821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 232/465] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:42 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:43.779483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:43.780189 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:43.786537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:43.787026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:43.787464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:43.788162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:43.788648 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:43.789076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:43.933679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:43.941710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6386b16e-3c2f-4e0b-a341-3ddaf16e1395 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.167651 Oct 03 13:34:43.942291 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 234/466] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:43 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:44.965387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:44.966040 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:44.972557 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:44.973043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:44.973513 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:44.974221 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:44.974677 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:44.975105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:45.114641 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:45.122600 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-54a1cb97-3ebd-4c6b-9cc1-0f428d57bcff tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1318 microversion: 2.1 time: 0.161661 Oct 03 13:34:45.123170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 233/467] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:44 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:46.025284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:46.025869 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:46.032862 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:46.033345 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:46.033810 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:46.034500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:46.034957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:46.035386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:46.064063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-8cd2c023-cec3-4e6e-8c37-33c3309b2ea9 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/ips" status: 200 len: 145 microversion: 2.1 time: 0.042425 Oct 03 13:34:46.064998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 235/468] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:34:46 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:34:46.146242 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:34:46.146895 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:46.154165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:46.154659 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:46.155117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:46.155805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:46.156265 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:46.156699 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:46.298001 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:34:46.305941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-100888e2-acf2-4682-b418-595611ce9bf2 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1508 microversion: 2.1 time: 0.163604 Oct 03 13:34:46.306516 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 234/469] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:34:46 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:34:46.335831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d004ace6-2991-4358-93e4-86be7d183b76", "device": "/dev/sdb"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:46.335831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:46.340014 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:46.340509 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:46.340951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:46.341695 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:46.342154 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:46.342591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:46.638557 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f4b6a56d-d9d5-407a-8951-4c821dee4e80 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "POST /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312489 Oct 03 13:34:46.639918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 236/470] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:34:46 2022] POST /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:34:52.871095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6098e5e-ee5b-46ab-91ab-684c176ac63e"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:34:52.874077 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:34:52.882172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:52.882670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:52.883116 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:52.883834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:34:52.884297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:34:52.884728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:34:53.622371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a96245ae-5e3b-451b-9898-150fafb33279 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755400 Oct 03 13:34:53.622885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 235/471] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:34:52 2022] POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:07.678829 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-58c2ccb9-ee12-4ad4-8fb0-07074cf3ab0f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:35:07.681663 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=20 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:07.683052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:07.690075 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58c2ccb9-ee12-4ad4-8fb0-07074cf3ab0f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:07.690571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58c2ccb9-ee12-4ad4-8fb0-07074cf3ab0f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:07.691009 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58c2ccb9-ee12-4ad4-8fb0-07074cf3ab0f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:07.777008 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-58c2ccb9-ee12-4ad4-8fb0-07074cf3ab0f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Going to try to stop instance {{(pid=120743) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 13:35:07.823078 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-58c2ccb9-ee12-4ad4-8fb0-07074cf3ab0f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/action" status: 202 len: 0 microversion: 2.1 time: 0.147877 Oct 03 13:35:07.824227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 237/472] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:35:07 2022] POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:35:07.832782 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:07.833535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:07.836252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:07.836927 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:07.843934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:07.844380 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:07.844886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:07.845557 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:07.846008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:07.846437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:08.003406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:08.013511 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e905d7e4-9ce7-46e4-afe6-c4e64802d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.184761 Oct 03 13:35:08.014112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 236/473] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:07 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:09.040332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:09.042584 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:09.054471 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:09.054983 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:09.055429 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:09.056147 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:09.056667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:09.057093 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:09.216715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:09.225867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bc9d9146-a251-4b0a-8e63-f0b1fd0d0de7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.192305 Oct 03 13:35:09.226450 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 238/474] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:09 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:09.323464 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:09.324168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:09.331030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:09.331834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:09.332277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:09.333026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:09.333701 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:09.334131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:09.469996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lazy-loading 'services' on Instance uuid 6b97156c-d1de-4e9e-9356-ab4510c0c633 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:35:09.595191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-09592039-75e1-43ab-97ad-b60da3b93bf9 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633/os-volume_attachments/d004ace6-2991-4358-93e4-86be7d183b76" status: 202 len: 0 microversion: 2.1 time: 0.276329 Oct 03 13:35:09.595947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 237/475] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:35:09 2022] DELETE /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633/os-volume_attachments/d004ace6-2991-4358-93e4-86be7d183b76 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:35:10.253799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:10.254414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:10.261227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:10.261744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:10.262186 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:10.262889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:10.263340 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:10.263761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:10.413615 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:10.423613 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-12942a26-8b54-43ce-9d15-692bc301fabb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.173937 Oct 03 13:35:10.424196 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 239/476] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:10 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:11.448731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:11.449467 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:11.456761 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:11.457254 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:11.457736 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:11.458455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:11.458914 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:11.459345 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:11.607296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:11.616033 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-847b2624-d9fa-4c07-bd88-0626885ec5e2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.172557 Oct 03 13:35:11.616611 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 238/477] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:11 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:12.640796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:12.641341 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:12.648007 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:12.648493 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:12.648965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:12.649692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:12.650771 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:12.651264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:12.802302 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:12.811441 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5548cbaa-eafc-4323-bc8b-d2610ffb2c8b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.174529 Oct 03 13:35:12.812031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 240/478] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:12 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:13.849946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:13.850560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:13.857625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:13.858117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:13.858549 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:13.859244 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:13.859693 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:13.860112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:14.009175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:14.018041 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a041765c-0bba-4829-9fe9-6ca41872ffdb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.172036 Oct 03 13:35:14.018610 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 239/479] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:13 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:15.041766 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:15.042518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:15.049221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:15.049745 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:15.050180 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:15.050878 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:15.051328 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:15.051746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:15.181308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:15.189675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3b823f6e-9a99-446a-92b0-f63b57302f7b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.152560 Oct 03 13:35:15.190304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 241/480] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:15 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:16.215383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:16.216138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:16.222781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:16.223280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:16.223714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:16.224400 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:16.224848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:16.225269 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:16.358364 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:16.367610 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b0259aa3-7392-4881-9b2b-1465b31817d4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.157090 Oct 03 13:35:16.368203 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 240/481] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:16 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:17.391466 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:17.392078 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:17.398563 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:17.399046 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:17.399483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:17.400327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:17.400808 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:17.401233 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:17.534831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:17.544414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-21991bb3-5576-49df-b1de-22c028f27548 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.156731 Oct 03 13:35:17.545005 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 242/482] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:17 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:18.568776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:18.569402 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:18.576013 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:18.576501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:18.576946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:18.577784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:18.578249 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:18.578679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:18.714355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:18.722697 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-64ebad90-d951-4c1a-9c5f-d7e12b3fc819 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.157808 Oct 03 13:35:18.723268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 241/483] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:18 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:19.747523 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:19.748125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:19.755258 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:19.755743 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:19.756280 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:19.757505 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:19.757961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:19.758387 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:19.891372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:19.900696 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-980bceae-95a1-442b-9dfb-d56f3ab70681 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.157106 Oct 03 13:35:19.901285 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 243/484] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:19 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:20.924461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:20.925071 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:20.932386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:20.932898 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:20.933377 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:20.934119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:20.934579 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:20.935006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:21.097190 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:21.106000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b88dcd50-57f4-40e1-9bd0-9b491b536193 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.185411 Oct 03 13:35:21.106577 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 242/485] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:20 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:22.130232 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:22.130841 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:22.138480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:22.139210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:22.139728 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:22.140646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:22.141179 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:22.141694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:22.513774 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:22.522115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-22452f30-09ab-4e81-8205-ffc53916d0a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.395998 Oct 03 13:35:22.522683 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 244/486] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:22 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:23.545596 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:23.546219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:23.553141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:23.553828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:23.554364 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:23.555237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:23.555809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:23.556433 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:23.698577 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:23.706921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-49243a38-bdad-449d-be97-469e2cc07a9e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.165331 Oct 03 13:35:23.707662 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 243/487] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:23 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:35:24.736165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:24.736893 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:24.744636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:24.745348 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:24.745823 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:24.746531 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:24.747035 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:24.747460 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:24.882371 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:24.890937 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-de35fae0-72cf-4b2c-b1a7-744e2feebdf8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.158741 Oct 03 13:35:24.891521 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 245/488] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:24 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:25.638463 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:25.639066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:25.645551 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:25.646030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:25.646461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:25.647170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:25.647619 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:25.648038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:25.674619 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:35:25.763485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-75736ef8-042d-4477-8613-320a896d8d89 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 204 len: 0 microversion: 2.1 time: 0.129187 Oct 03 13:35:25.765090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 244/489] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:35:25 2022] DELETE /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:35:25.772858 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:25.773720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:25.781438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:25.781957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:25.782384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:25.783071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:25.783518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:25.783933 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:25.920183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:25.921498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:25.931521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:25.932119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:25.932682 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:25.933053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:25.933607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:25.934145 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:25.934610 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:25.941394 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-db755386-aaa5-4c32-aef0-a4ba730b48c8 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1514 microversion: 2.1 time: 0.172719 Oct 03 13:35:25.942000 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 246/490] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:25 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:26.076825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:26.085755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d55cc7ee-0c99-4a1b-a5f2-62bc56a33fbf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.174162 Oct 03 13:35:26.086340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 245/491] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:25 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:26.965241 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:26.965898 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:26.972405 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:26.972897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:26.973329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:26.974054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:26.974507 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:26.974930 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:27.108194 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:27.110040 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:27.110661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:27.115954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ea8e18da-d852-4a89-9f00-8c45e58506e1 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1514 microversion: 2.1 time: 0.155029 Oct 03 13:35:27.116528 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 247/492] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:26 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:27.117143 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:27.117665 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:27.118111 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:27.119407 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:27.119867 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:27.120298 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:27.252579 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:27.264284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d15cb367-3780-4690-9810-4fcded3607fb tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.157990 Oct 03 13:35:27.264985 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 246/493] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:27 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:35:28.141681 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:28.142285 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:28.148619 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:28.149094 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:28.150201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:28.150985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:28.151433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:28.151851 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:28.287849 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:28.288469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:28.289238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:28.295153 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:28.295631 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:28.296066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:28.296761 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:28.297214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:28.297607 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-77601b4e-d343-4833-804b-6e9895d1e3ed tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1514 microversion: 2.1 time: 0.159753 Oct 03 13:35:28.297858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:28.298189 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 248/494] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:28 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:28.445152 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:28.454569 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0faa9e62-1b84-4f81-9836-3b2a014f0429 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1723 microversion: 2.1 time: 0.170421 Oct 03 13:35:28.455375 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 247/495] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:28 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:35:29.292533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-24b98dd1-efd5-4a04-ad4b-0dbaf727cab8 req-cc561b9d-66d9-4169-92f6-6183b5d8bf5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b97156c-d1de-4e9e-9356-ab4510c0c633", "name": "network-vif-deleted", "tag": "96970edd-6135-4b48-bcb5-acaaa6b38d2b"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:35:29.303433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-24b98dd1-efd5-4a04-ad4b-0dbaf727cab8 req-cc561b9d-66d9-4169-92f6-6183b5d8bf5b service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:29.304016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-24b98dd1-efd5-4a04-ad4b-0dbaf727cab8 req-cc561b9d-66d9-4169-92f6-6183b5d8bf5b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:29.304449 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-24b98dd1-efd5-4a04-ad4b-0dbaf727cab8 req-cc561b9d-66d9-4169-92f6-6183b5d8bf5b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:29.316051 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-24b98dd1-efd5-4a04-ad4b-0dbaf727cab8 req-cc561b9d-66d9-4169-92f6-6183b5d8bf5b service nova] Creating event network-vif-deleted:96970edd-6135-4b48-bcb5-acaaa6b38d2b for instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 on hv-cinder-86009 Oct 03 13:35:29.320731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:29.321953 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:29.324458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-24b98dd1-efd5-4a04-ad4b-0dbaf727cab8 req-cc561b9d-66d9-4169-92f6-6183b5d8bf5b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Oct 03 13:35:29.325176 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 249/496] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:29.329295 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:29.329827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:29.330295 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:29.330985 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:29.331480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:29.332019 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:29.482434 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:29.483217 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:29.489721 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:29.490522 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:29.491370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:29.491705 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:29.492156 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:29.492573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:29.611209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e5a47c5b314a0486d3a32ffbead793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33af9400d270489da18c21dee3f9188f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:29.624625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b8e2e2b1-4f36-46dd-af13-87fffca78cd3 tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 200 len: 1303 microversion: 2.1 time: 0.307983 Oct 03 13:35:29.626238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 248/497] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:29 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 1303 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:29.655249 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:29.667378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c76e3eb7-dad3-4bbf-a0a0-4b45323574a6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1700 microversion: 2.1 time: 0.189973 Oct 03 13:35:29.668240 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 250/498] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:29 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1700 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:35:29.691229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-dbb36f21-08a2-4490-abfc-71d58a417ce2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:35:29.698788 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbb36f21-08a2-4490-abfc-71d58a417ce2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:29.699370 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbb36f21-08a2-4490-abfc-71d58a417ce2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:29.700219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbb36f21-08a2-4490-abfc-71d58a417ce2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:29.770633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-dbb36f21-08a2-4490-abfc-71d58a417ce2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Going to try to start instance {{(pid=120742) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 13:35:29.788348 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:29.816930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-dbb36f21-08a2-4490-abfc-71d58a417ce2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/action" status: 202 len: 0 microversion: 2.1 time: 0.129798 Oct 03 13:35:29.817557 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 249/499] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:35:29 2022] POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:35:29.825905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:29.826530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:29.832673 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:29.833165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:29.833654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:29.834355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:29.834813 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:29.835238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:29.968643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:29.977198 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e277debd-fee8-4d01-9c67-aab7ca16e296 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1709 microversion: 2.1 time: 0.155284 Oct 03 13:35:29.978307 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 251/500] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:29 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:35:30.648300 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:30.650335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] [instance: 6b97156c-d1de-4e9e-9356-ab4510c0c633] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:30.657435 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:30.657971 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:30.658441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:30.659291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:30.659753 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:30.660217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:30.675055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] HTTP exception thrown: Instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 could not be found. Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Request method failure captured: Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 HTTP/1.1 Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuSBd50mGHrjL8Ok6lrph9KaIGUzAtsqgIP-fcpaOsgtvVYZPPkbntH-kNkcAj95zwt7lNwJ84moZjd8PkIJPW6EbepDb81Js8PV0BBx293ArZn4m6c2N31hTmu73_BDfgUULyWfSr8o9zZbi07-sPbyW5r9OANya58Wu7LqPoTM-Bc Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 33af9400d270489da18c21dee3f9188f Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-VolumesSnapshotTestJSON-986009736 Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:35:30.676865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33af9400d270489da18c21dee3f9188f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33af9400d270489da18c21dee3f9188f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33af9400d270489da18c21dee3f9188f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33af9400d270489da18c21dee3f9188f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-VolumesSnapshotTestJSON-986009736 Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 33af9400d270489da18c21dee3f9188f Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-986009736 Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-VolumesSnapshotTestJSON-986009736-project Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 75e5a47c5b314a0486d3a32ffbead793 Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-VolumesSnapshotTestJSON-986009736-project Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 could not be found. Oct 03 13:35:30.678721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '6b97156c-d1de-4e9e-9356-ab4510c0c633'} Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 could not be found. Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:35:30.679584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 could not be found. Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 could not be found. Oct 03 13:35:30.680961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:30.682112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] Returning 404 to user: Instance 6b97156c-d1de-4e9e-9356-ab4510c0c633 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:35:30.682112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-71c96c73-0755-474a-8ed3-d7a2cba489ca tempest-VolumesSnapshotTestJSON-986009736 tempest-VolumesSnapshotTestJSON-986009736-project] 10.222.0.58 "GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633" status: 404 len: 111 microversion: 2.1 time: 0.034507 Oct 03 13:35:30.682112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 250/501] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:30 2022] GET /compute/v2.1/servers/6b97156c-d1de-4e9e-9356-ab4510c0c633 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:35:31.006105 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:31.006837 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:31.014357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:31.015136 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:31.015430 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:31.016032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:31.016712 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:31.016992 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:31.308929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:31.317276 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5f458307-6432-454a-a26d-5fc3195750b8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1709 microversion: 2.1 time: 0.316427 Oct 03 13:35:31.317881 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 252/502] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:30 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1709 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:31.824141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:31.824678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:31.830885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:31.831366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:31.831798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:31.832762 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:31.833225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:31.833680 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:31.857663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-eafafcfa-78f3-44c6-844a-57d22025d25b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8/ips" status: 200 len: 148 microversion: 2.1 time: 0.037417 Oct 03 13:35:31.858208 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 251/503] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:35:31 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:31.870794 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "782d7b63-609f-4c91-8040-8ac420416026"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:35:31.873568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:31.879758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:31.880242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:31.880676 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:31.881362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:31.882001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:31.882294 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:31.886185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:31.966022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Invalid volume: volume 782d7b63-609f-4c91-8040-8ac420416026 is already attached to instances: 7a9ff191-d009-41e4-9966-44fe462252b5 Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: POST /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8/os-volume_attachments HTTP/1.1 Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 74 Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:35:31.967746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {"volumeAttachment": {"volumeId": "782d7b63-609f-4c91-8040-8ac420416026"}} Oct 03 13:35:31.969273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Invalid volume: volume 782d7b63-609f-4c91-8040-8ac420416026 is already attached to instances: 7a9ff191-d009-41e4-9966-44fe462252b5 Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'server_id': '1530d3cd-a03d-4ccc-bf56-064b83e978c8', 'body': {'volumeAttachment': {'volumeId': '782d7b63-609f-4c91-8040-8ac420416026'}}} Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 782d7b63-609f-4c91-8040-8ac420416026 is already attached to instances: 7a9ff191-d009-41e4-9966-44fe462252b5 Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:31.970278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 782d7b63-609f-4c91-8040-8ac420416026 is already attached to instances: 7a9ff191-d009-41e4-9966-44fe462252b5 Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:31.971708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:35:31.973310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:35:31.973310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:35:31.973310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:35:31.973310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 782d7b63-609f-4c91-8040-8ac420416026 is already attached to instances: 7a9ff191-d009-41e4-9966-44fe462252b5 Oct 03 13:35:31.973310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:31.973310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 400 to user: Invalid volume: volume 782d7b63-609f-4c91-8040-8ac420416026 is already attached to instances: 7a9ff191-d009-41e4-9966-44fe462252b5 {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:35:31.973310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f6b11841-5e1b-40c7-aef6-01e0fd9fe703 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103097 Oct 03 13:35:31.973310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 253/504] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:35:31 2022] POST /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:35:31.978713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:31.979216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:31.985290 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:31.985825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:31.986279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:31.986983 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:31.987443 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:31.987875 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:32.014295 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:35:32.098390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-28b5f8f3-7ec3-46c3-841d-9ce8f6276251 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 204 len: 0 microversion: 2.1 time: 0.123780 Oct 03 13:35:32.099045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 252/505] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:35:31 2022] DELETE /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 13:35:32.109084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:32.109839 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:32.119612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:32.120225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:32.120731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:32.121545 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:32.122136 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:32.122658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:32.266094 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:32.274108 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-87e22a91-d564-4020-bff2-a6c388d048c4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1681 microversion: 2.1 time: 0.170070 Oct 03 13:35:32.274702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 254/506] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:32 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:32.342848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:32.343576 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:32.349581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:32.350066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:32.350495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:32.351177 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:32.351625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:32.352050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:32.488177 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:32.498732 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f42708f7-38fb-449c-921d-297efebb5042 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1713 microversion: 2.1 time: 0.159999 Oct 03 13:35:32.499464 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 253/507] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:32 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:33.297534 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:33.298152 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:33.304652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:33.305137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:33.306207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:33.306920 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:33.307377 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:33.307805 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:33.447914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:33.455729 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-927112ad-9247-4006-b8c4-9a307c4b3da5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1681 microversion: 2.1 time: 0.162031 Oct 03 13:35:33.456230 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 255/508] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:33 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:34.480470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:34.481114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:34.487744 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:34.488168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:34.488630 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:34.489334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:34.489825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:34.490256 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:34.619337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:34.632113 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d47ea5b9-e7d9-4023-a377-f5ae4f4be19a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1681 microversion: 2.1 time: 0.156169 Oct 03 13:35:34.632679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 254/509] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:34 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:35.662577 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:35.663263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:35.670927 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:35.671413 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:35.671849 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:35.672542 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:35.672994 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:35.673420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:35.812071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:35.819727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c1e02356-7f2c-4264-b04b-f1f6299f68c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1681 microversion: 2.1 time: 0.161264 Oct 03 13:35:35.820295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 256/510] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:35 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:36.843982 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:36.844626 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:36.851102 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:36.851589 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:36.852048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:36.852854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:36.853491 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:36.853963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:36.991381 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:36.999029 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6098a17b-ca92-4cb7-bf27-ac312e7a142d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1681 microversion: 2.1 time: 0.158935 Oct 03 13:35:36.999586 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 255/511] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:36 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:37.937374 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-55544122-70e3-4f60-919d-d59bdc3a9467 req-5c205e32-af5f-4c0d-94d9-eafc7a6f7d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1530d3cd-a03d-4ccc-bf56-064b83e978c8", "name": "network-vif-deleted", "tag": "fb7024a0-6b02-454f-ba31-1290a4622c59"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:35:37.944895 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=41 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:37.951137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-55544122-70e3-4f60-919d-d59bdc3a9467 req-5c205e32-af5f-4c0d-94d9-eafc7a6f7d9e service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:37.951619 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-55544122-70e3-4f60-919d-d59bdc3a9467 req-5c205e32-af5f-4c0d-94d9-eafc7a6f7d9e service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:37.952048 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-55544122-70e3-4f60-919d-d59bdc3a9467 req-5c205e32-af5f-4c0d-94d9-eafc7a6f7d9e service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:37.964511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-55544122-70e3-4f60-919d-d59bdc3a9467 req-5c205e32-af5f-4c0d-94d9-eafc7a6f7d9e service nova] Creating event network-vif-deleted:fb7024a0-6b02-454f-ba31-1290a4622c59 for instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 on hv-cinder-86009 Oct 03 13:35:37.970814 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-55544122-70e3-4f60-919d-d59bdc3a9467 req-5c205e32-af5f-4c0d-94d9-eafc7a6f7d9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036932 Oct 03 13:35:37.971760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 257/512] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:38.023891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:38.025250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:38.028710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:38.036866 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:38.037914 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:38.038945 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:38.040541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:38.042179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:38.042954 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:38.086098 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:38.086587 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:38.088382 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:38.089039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lazy-loading 'fault' on Instance uuid 1530d3cd-a03d-4ccc-bf56-064b83e978c8 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:35:38.157082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:38.171651 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a9b38e7e-374e-4c85-8f70-8fcaaf9e3973 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 200 len: 1332 microversion: 2.1 time: 0.151397 Oct 03 13:35:38.172592 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 256/513] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:38 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 1332 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:39.199777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:39.200497 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:39.208197 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:39.208567 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:39.208954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:39.209914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:39.210459 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:39.210804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:39.226460 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 HTTP/1.1 Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:35:39.228222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:35:39.229904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '1530d3cd-a03d-4ccc-bf56-064b83e978c8'} Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:35:39.230812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:35:39.232242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:35:39.234925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:35:39.234925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-79b76f0d-d9e4-4ae0-9623-2190748d6662 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 404 len: 111 microversion: 2.1 time: 0.035331 Oct 03 13:35:39.234925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 258/514] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:39 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:35:39.238998 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0d79808b-e3e8-485e-bc33-863375816189 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '.version_select at 0x7f7c21ae1f70>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:39.272081 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0d79808b-e3e8-485e-bc33-863375816189 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064142744" status: 202 len: 0 microversion: 2.1 time: 0.036950 Oct 03 13:35:39.277626 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 257/515] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Oct 3 13:35:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064142744 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:35:39.839809 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dba48e7f-e597-4b92-be26-2a04b4c37ff4"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:35:39.842212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:39.848814 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:39.849160 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:39.849625 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:39.850379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:39.850829 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:39.851253 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:40.121133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:40.121677 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:40.128886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:40.129389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:40.129864 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:40.130644 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:40.131109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:40.131572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:40.247500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lazy-loading 'services' on Instance uuid 7a9ff191-d009-41e4-9966-44fe462252b5 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:35:40.406705 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a8cad2a7-c520-4ff1-8dbc-c5168004f2e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments/782d7b63-609f-4c91-8040-8ac420416026" status: 202 len: 0 microversion: 2.1 time: 0.289278 Oct 03 13:35:40.411696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 258/516] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:35:40 2022] DELETE /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments/782d7b63-609f-4c91-8040-8ac420416026 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 13:35:40.417806 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9fd54e15-14a3-4277-991c-dcc6c76e7876 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581846 Oct 03 13:35:40.419351 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 259/517] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:35:39 2022] POST /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:40.420638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:40.423640 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:40.448130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:40.449601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:40.450314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:40.451309 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:40.452195 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:40.453010 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:40.499730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-244cdd72-41e2-4cbd-bf15-c3e58de062c5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086108 Oct 03 13:35:40.500319 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 259/518] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:40 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:41.514299 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:41.516285 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:41.523205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:41.523694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:41.524729 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:41.525436 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:41.525918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:41.526345 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:41.559896 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da1a281c-b787-411b-9492-63100c4d95a4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051248 Oct 03 13:35:41.560701 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 260/519] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:41 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:42.572776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:42.574988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:42.581521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:42.582016 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:42.582459 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:42.583157 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:42.583616 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:42.584047 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:42.635153 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c99c2224-3945-446a-9f78-41291e03163e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066413 Oct 03 13:35:42.635787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 260/520] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:42 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:43.647784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:43.651143 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:43.657818 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:43.658292 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:43.658721 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:43.659402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:43.659845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:43.660262 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:43.690439 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9e8ebb19-4dc5-4204-b3f5-026290eb5c61 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Oct 03 13:35:43.691005 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 261/521] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:43 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:44.703087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:44.705266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:44.712443 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:44.713043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:44.713518 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:44.714222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:44.714678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:44.715108 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:44.746230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-aae07ad3-cd9a-438c-ad19-bc1ca352177f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047053 Oct 03 13:35:44.746842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 261/522] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:44 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:45.759281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:45.762022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:45.768660 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:45.769148 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:45.769611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:45.770315 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:45.770769 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:45.771194 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:45.809910 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dfeb288f-e5fc-491d-b479-fdd10f84c62f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054588 Oct 03 13:35:45.810657 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 262/523] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:45 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:46.822972 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:46.827898 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:46.834594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:46.835088 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:46.835529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:46.836235 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:46.836690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:46.837116 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:46.870045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-02c5641d-3364-4b16-b616-cb64711416c6 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051043 Oct 03 13:35:46.870647 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 262/524] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:46 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:47.883076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:47.885833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:47.892646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:47.893134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:47.893610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:47.894320 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:47.894780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:47.895210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:47.927115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ba98ccab-64e5-4381-a375-2a95d31778e9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048079 Oct 03 13:35:47.927689 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 263/525] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:47 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:48.940445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:48.942602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:48.949735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:48.950213 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:48.950648 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:48.951328 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:48.951780 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:48.952195 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:48.982034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c6528bbf-736a-4c94-b9ed-d2ffa85b31c1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Oct 03 13:35:48.982595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 263/526] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:48 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:50.107829 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:50.109988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:50.115886 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:50.116366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:50.116800 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:50.117670 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:50.118130 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:50.118556 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:50.148409 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5ef6c01d-fad3-41bf-8401-8ee37333fc74 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158329 Oct 03 13:35:50.148969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 264/527] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:49 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:35:51.161916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:51.164070 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:51.171289 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:51.171812 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:51.172265 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:51.172968 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:51.173422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:51.173885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:51.205041 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2b6b074e-feac-4e5c-aa62-232cd4261ae2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047240 Oct 03 13:35:51.205648 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 264/528] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:51 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:52.217824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:52.219969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:52.227369 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:52.228030 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:52.228658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:52.229582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:52.230038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:52.230474 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:52.264059 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0aa2b6e3-818b-4393-ad87-3ea852e50a78 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050149 Oct 03 13:35:52.264637 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 265/529] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:52 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:35:53.278441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:53.282104 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:53.292067 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:53.292658 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:53.293110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:53.293928 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:53.294564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:53.295008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:53.299069 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:53.331356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7c0b95ee-16fa-4d89-a40f-372f09b9d004 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058295 Oct 03 13:35:53.332297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 265/530] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:53 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:53.547512 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:35:53.549932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:53.556630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:53.557152 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:53.558347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:53.559155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:53.559722 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:53.560226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:53.584789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lazy-loading 'flavor' on Instance uuid 959d25e3-1620-4fb7-836c-7d55711fda46 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:35:53.709304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f938e9b5-48f9-4172-9f4e-2f2ae4d054d4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/action" status: 200 len: 32 microversion: 2.1 time: 0.165957 Oct 03 13:35:53.710033 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 266/531] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:35:53 2022] POST /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:35:53.721145 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:53.721909 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:53.728368 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:53.728948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:53.730076 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:53.730924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:53.731456 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:53.731936 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:53.876045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:53.884715 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9bb90f15-968f-4eb2-93cd-62234f911fc6 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.167425 Oct 03 13:35:53.885327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 266/532] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:53 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:54.346080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:54.348680 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:54.356608 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:54.357243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:54.357732 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:54.358442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:54.358900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:54.359327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:54.389599 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:35:54.394694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3e645c6f-2ebd-48f3-9fbb-6dd708851d31 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053926 Oct 03 13:35:54.395499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 267/533] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:35:54 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:35:54.465470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:54.466011 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:54.476024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:54.476731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:54.477192 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:54.477948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:54.478467 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:54.478905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:54.506405 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:35:54.580978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-fc4e3efb-49d2-4ee8-894b-6f55e0ced3ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 204 len: 0 microversion: 2.1 time: 0.119667 Oct 03 13:35:54.581806 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 267/534] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:35:54 2022] DELETE /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:35:54.591961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:54.592526 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:54.599996 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:54.600485 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:54.600909 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:54.601688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:54.602124 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:54.602543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:54.742252 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:54.750903 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bf8454b9-ac79-4de5-9e7e-3ea38d087110 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1682 microversion: 2.1 time: 0.164022 Oct 03 13:35:54.751760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 268/535] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:54 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:54.909209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:54.909855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:54.916230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:54.916708 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:54.917170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:54.917969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:54.918423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:54.918847 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:55.048701 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:55.057255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-249151e7-a7cf-41ad-a61b-aa4f8bee5ea7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.152308 Oct 03 13:35:55.057873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 268/536] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:54 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:55.776877 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:55.778279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:55.780549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:35:55.780701 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Mon Oct 3 13:35:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 (ip 10.222.0.58) !!! Oct 03 13:35:55.787469 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:55.787945 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:55.788374 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:55.789067 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:55.789614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:55.790038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:56.080141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:56.080758 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:56.087407 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:56.087890 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:56.088335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:56.089594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:56.090429 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:56.090900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:56.230519 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:56.239025 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e21cd55a-78f7-4573-bafd-fd3feb863eca tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.162755 Oct 03 13:35:56.239696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 269/537] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:56 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:35:56.265652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:56.275976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-23bd48c5-308f-4969-b1b6-09e538736408 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1682 microversion: 2.1 time: 0.503611 Oct 03 13:35:56.277163 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 269/538] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:55 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1682 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:57.265808 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:57.266431 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:57.273166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:57.273688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:57.274129 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:57.274823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:57.275277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:57.275700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:57.300189 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:57.300752 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:57.307850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:57.308394 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:57.309055 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:57.309811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:57.310272 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:57.310702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:57.407495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:57.415791 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-829b0bef-75c1-4e42-8fac-dd2124aa1a27 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.154078 Oct 03 13:35:57.416362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 270/539] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:57 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:57.562611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:57.570913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3a7e688f-0a81-4932-ab11-02338148f490 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1682 microversion: 2.1 time: 0.274834 Oct 03 13:35:57.571595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 270/540] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:57 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1682 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:57.950873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-987b668b-e0d5-4de6-877d-ea452ae82e9b req-a8ed93d0-0699-4619-b189-fd62882bf5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9ff191-d009-41e4-9966-44fe462252b5", "name": "network-vif-deleted", "tag": "316014ae-7577-478c-97b0-af9327de5aca"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:35:57.961603 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-987b668b-e0d5-4de6-877d-ea452ae82e9b req-a8ed93d0-0699-4619-b189-fd62882bf5dd service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:57.962096 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-987b668b-e0d5-4de6-877d-ea452ae82e9b req-a8ed93d0-0699-4619-b189-fd62882bf5dd service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:57.962555 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-987b668b-e0d5-4de6-877d-ea452ae82e9b req-a8ed93d0-0699-4619-b189-fd62882bf5dd service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:57.975099 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-987b668b-e0d5-4de6-877d-ea452ae82e9b req-a8ed93d0-0699-4619-b189-fd62882bf5dd service nova] Creating event network-vif-deleted:316014ae-7577-478c-97b0-af9327de5aca for instance 7a9ff191-d009-41e4-9966-44fe462252b5 on hv-cinder-86009 Oct 03 13:35:57.982022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-987b668b-e0d5-4de6-877d-ea452ae82e9b req-a8ed93d0-0699-4619-b189-fd62882bf5dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035299 Oct 03 13:35:57.982393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 271/541] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:35:58.438922 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:58.439606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:58.446368 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:58.446952 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:58.447403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:58.448172 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:58.448737 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:58.449383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:58.587593 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:58.595593 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:58.596489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:58.597143 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-49518243-74ee-481a-8eea-0578b708408d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.161968 Oct 03 13:35:58.597958 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 271/542] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:58 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:58.603865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:58.605024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:58.605665 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:58.606502 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:58.607066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:58.607664 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:58.653660 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:58.654236 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:58.654738 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:58.655258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lazy-loading 'fault' on Instance uuid 7a9ff191-d009-41e4-9966-44fe462252b5 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:35:58.703910 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:58.712353 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2942b24a-c7f2-45e7-b37b-b1ac5a580e4b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 200 len: 1331 microversion: 2.1 time: 0.121141 Oct 03 13:35:58.712929 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 272/543] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:58 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:35:59.622129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:59.622737 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:59.629444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:59.629957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:59.630389 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:59.631079 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:59.631526 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:59.631946 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:59.735565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:59.736172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:35:59.742753 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:59.743232 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:59.743661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:59.744357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:35:59.745299 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:35:59.746013 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:35:59.759722 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:35:59.761847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 HTTP/1.1 Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:35:59.762216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:35:59.763913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '7a9ff191-d009-41e4-9966-44fe462252b5'} Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:35:59.764988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:35:59.766419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:35:59.767839 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:35:59.767839 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d3c91d5a-11aa-4304-9edf-091e3cb44cf2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 404 len: 111 microversion: 2.1 time: 0.031882 Oct 03 13:35:59.767839 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 273/544] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:59 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:35:59.770501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5c35cfe3-bbd3-4412-af04-c0cd53cdd439 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.152982 Oct 03 13:35:59.771071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 272/545] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:35:59 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:35:59.772684 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-618c3951-26b4-4070-af96-b129bea02975 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '.version_select at 0x7f7c2194f310>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:35:59.791615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-618c3951-26b4-4070-af96-b129bea02975 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942204156" status: 202 len: 0 microversion: 2.1 time: 0.022656 Oct 03 13:35:59.792184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 274/546] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Oct 3 13:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942204156 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:36:00.446194 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-79674fae-db45-469c-9638-be662ab37886 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: .version_select at 0x7f7c21a25280>, body: {"keypair": {"name": "tempest-keypair-1843650383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6BG+oUjIwh/h3m7FU7cRxTh/VBD6OjkbAOpyP98x/jYWCTLuBY9jPZrrc8x1f7HpkefN+pKmVW+yco991m43yuASsEXnI61oG6L4f64Aa1mKxsOhwhia0pCWrGRxeKMw=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:00.467162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-79674fae-db45-469c-9638-be662ab37886 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:36:00.471593 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-79674fae-db45-469c-9638-be662ab37886 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for user 98de1ccbabc64162a29cbce2cfe11600 and project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:36:00.513797 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-79674fae-db45-469c-9638-be662ab37886 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071422 Oct 03 13:36:00.514412 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 273/547] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:36:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:36:00.796305 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:00.796934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:00.803994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:00.804486 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:00.804929 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:00.805671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:00.806132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:00.806560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:00.945905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:00.955430 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5c8e06c8-2435-40d6-a0d3-6b93c8edbe57 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.164646 Oct 03 13:36:00.956027 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 275/548] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:00 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:01.889873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-90631266", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff8319e2-24e1-46c8-a6e2-568f9c4503d6"}], "security_groups": [{"name": "tempest-securitygroup--546607667"}], "key_name": "tempest-keypair-1843650383", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:01.986435 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:01.987613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:01.999837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:02.000661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:02.001996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:02.002968 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:02.003713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:02.003818 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] validate_networks() for [('ff8319e2-24e1-46c8-a6e2-568f9c4503d6', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:36:02.004501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:02.180013 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:02.192779 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-74edfddf-c8bd-4d9d-8198-df62b84c0e76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.214989 Oct 03 13:36:02.193822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 276/549] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:01 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:02.514669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:36:02.515090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:36:02.515572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:36:02.516205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:36:02.516614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:36:02.525964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:02.527251 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:02.527692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:02.528441 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:02.528893 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:02.529318 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:02.548042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:36:02.552312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for user 98de1ccbabc64162a29cbce2cfe11600 and project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:36:02.563785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:36:02.566136 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:36:02.616487 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-984ddaec-f5d6-4c97-8f21-1b1974651385 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.732376 Oct 03 13:36:02.617138 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 274/550] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:36:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:36:02.629624 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-50f49653-b5c8-46db-96b0-61df74f41769 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:02.630179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-50f49653-b5c8-46db-96b0-61df74f41769 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:02.690307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-50f49653-b5c8-46db-96b0-61df74f41769 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:02.697669 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-50f49653-b5c8-46db-96b0-61df74f41769 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1240 microversion: 2.1 time: 0.072045 Oct 03 13:36:02.699333 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 277/551] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:02 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:03.235164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:03.235779 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:03.241974 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:03.242458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:03.242892 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:03.243615 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:03.244067 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:03.244489 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:03.383632 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:03.392985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c5d73337-8f00-4bf6-a4d7-b71a843f811a tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.162669 Oct 03 13:36:03.393591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 275/552] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:03 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:03.722826 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:03.723485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:03.731199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:03.731686 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:03.732130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:03.732864 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:03.733317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:03.733777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:03.794923 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:03.802688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9358b46f-9f11-4c7f-919e-d2d777bb6dba tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1292 microversion: 2.1 time: 0.085129 Oct 03 13:36:03.803250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 278/553] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:03 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:04.417723 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:04.418303 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:04.424689 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:04.425175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:04.425654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:04.426357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:04.426812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:04.427235 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:04.636505 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:04.645062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a6b867fb-2c83-4553-9c2c-17ddfb1aa794 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.231898 Oct 03 13:36:04.645772 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 276/554] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:04 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:04.827444 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:04.828150 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:04.834411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:04.834898 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:04.835337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:04.836035 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:04.836488 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:04.836914 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:05.004116 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:05.013240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-27b36a83-a740-42b5-92b3-3cebde43fbd5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1365 microversion: 2.1 time: 0.190320 Oct 03 13:36:05.014179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 279/555] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:04 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:05.624653 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-3203a734-22d1-41a6-a8c3-1e2f099d803b req-83b854fb-58a4-4f3d-9d93-5238a3e2e891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9b4c95-6c82-4aca-97eb-44eb954c5ca0", "tag": "a5a296ca-8101-49f0-b8d4-84e8c485eb14"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:05.641347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3203a734-22d1-41a6-a8c3-1e2f099d803b req-83b854fb-58a4-4f3d-9d93-5238a3e2e891 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:05.641871 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3203a734-22d1-41a6-a8c3-1e2f099d803b req-83b854fb-58a4-4f3d-9d93-5238a3e2e891 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:05.642762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3203a734-22d1-41a6-a8c3-1e2f099d803b req-83b854fb-58a4-4f3d-9d93-5238a3e2e891 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:05.658478 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-3203a734-22d1-41a6-a8c3-1e2f099d803b req-83b854fb-58a4-4f3d-9d93-5238a3e2e891 service nova] Creating event network-changed:a5a296ca-8101-49f0-b8d4-84e8c485eb14 for instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 on hv-cinder-86009 Oct 03 13:36:05.664986 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-3203a734-22d1-41a6-a8c3-1e2f099d803b req-83b854fb-58a4-4f3d-9d93-5238a3e2e891 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045578 Oct 03 13:36:05.666005 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 277/556] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:36:05.672656 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:05.673314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:05.679564 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:05.680046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:05.680482 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:05.681222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:05.681739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:05.682747 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:05.821082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:05.830078 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-16a6f691-1979-4b98-b241-90808c4c7893 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.161304 Oct 03 13:36:05.830733 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 280/557] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:05 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:06.036726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:06.037540 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:06.045411 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:06.045938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:06.046375 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:06.047105 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:06.047560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:06.047986 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:06.186106 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:06.193750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5135e71f-e4a9-4928-941f-b85929bfeecd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1365 microversion: 2.1 time: 0.161275 Oct 03 13:36:06.194324 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 278/558] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:06 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:06.854750 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:06.855553 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:06.861841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:06.862329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:06.862776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:06.863477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:06.863933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:06.864364 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:07.000140 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:07.008917 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d7d74912-d921-4f1f-aa13-097152a7b7d0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.158696 Oct 03 13:36:07.009548 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 281/559] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:06 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:07.217611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:07.218225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:07.224656 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:07.225140 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:07.225592 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:07.226306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:07.226754 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:07.227170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:07.449784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:07.457923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c866c16b-0f87-4205-9a1a-7d2094219739 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1365 microversion: 2.1 time: 0.244744 Oct 03 13:36:07.458676 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 279/560] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:07 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:08.033819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:08.034439 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:08.041085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:08.041841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:08.042300 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:08.042992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:08.043453 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:08.043887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:08.171147 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:08.179685 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b6e94514-cf2b-4901-84d9-209d88b8ecc8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.149709 Oct 03 13:36:08.180256 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 282/561] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:08 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:08.485144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:08.485786 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:08.488232 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:08.494327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:08.495681 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:08.496459 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:08.497291 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:08.497843 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:08.498287 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:08.633758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:08.641513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-151ba7a1-b8aa-4ca6-a680-6940239b214f tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1365 microversion: 2.1 time: 0.160281 Oct 03 13:36:08.642113 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 280/562] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:08 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:36:09.204292 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:09.205087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:09.207467 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:09.212992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:09.213760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:09.214188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:09.214897 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:09.215362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:09.215791 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:09.220661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:09.277113 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-088a6d55-bd2a-43df-91f2-e8ea0384a134 req-e30737d6-69eb-4b75-8f3f-0c5f0b75e4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9b4c95-6c82-4aca-97eb-44eb954c5ca0", "name": "network-vif-plugged", "status": "completed", "tag": "a5a296ca-8101-49f0-b8d4-84e8c485eb14"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:09.287916 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-088a6d55-bd2a-43df-91f2-e8ea0384a134 req-e30737d6-69eb-4b75-8f3f-0c5f0b75e4c2 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:09.288403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-088a6d55-bd2a-43df-91f2-e8ea0384a134 req-e30737d6-69eb-4b75-8f3f-0c5f0b75e4c2 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:09.288839 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-088a6d55-bd2a-43df-91f2-e8ea0384a134 req-e30737d6-69eb-4b75-8f3f-0c5f0b75e4c2 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:09.301046 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-088a6d55-bd2a-43df-91f2-e8ea0384a134 req-e30737d6-69eb-4b75-8f3f-0c5f0b75e4c2 service nova] Creating event network-vif-plugged:a5a296ca-8101-49f0-b8d4-84e8c485eb14 for instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 on hv-cinder-86009 Oct 03 13:36:09.312000 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-088a6d55-bd2a-43df-91f2-e8ea0384a134 req-e30737d6-69eb-4b75-8f3f-0c5f0b75e4c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039662 Oct 03 13:36:09.313014 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 281/563] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:36:09.363750 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:09.373111 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5a4a0190-d711-4c01-86ef-c0faa1b944c7 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.172772 Oct 03 13:36:09.373733 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 283/564] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:09 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:09.665242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:09.665981 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:09.672891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:09.673377 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:09.673842 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:09.674539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:09.674993 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:09.675424 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:09.804349 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:09.812048 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-981c5c6a-7bee-4acc-b816-07a65612d3d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1365 microversion: 2.1 time: 0.151572 Oct 03 13:36:09.812610 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 282/565] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:09 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:10.398404 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:10.399020 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:10.405558 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:10.406052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:10.406506 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:10.407204 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:10.407670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:10.408102 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:10.544017 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:10.552383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4ce3999b-3029-49aa-9b81-1e15ae18b38e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.157854 Oct 03 13:36:10.552956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 284/566] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:10 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:10.835826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:10.836426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:10.843825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:10.844308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:10.844744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:10.845438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:10.845914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:10.846351 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:11.215821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:11.223440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0c95b395-fbf7-47a1-a42c-036fadddfa0a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1365 microversion: 2.1 time: 0.391523 Oct 03 13:36:11.224004 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 283/567] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:10 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:11.579234 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:11.579234 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:11.584898 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:11.585561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:11.586214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:11.586983 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:11.587528 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:11.587956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:11.734626 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:11.746277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-893a17b5-e57d-44ee-aac0-4eb5e4920b73 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.173594 Oct 03 13:36:11.746873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 285/568] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:11 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:12.248045 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:12.248845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:12.255628 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:12.256108 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:12.256547 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:12.257248 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:12.257733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:12.258169 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:12.398775 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:12.408390 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5d113249-5624-47e1-bf9e-650c5642c0b1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1554 microversion: 2.1 time: 0.164915 Oct 03 13:36:12.409085 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 284/569] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:12 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:12.439002 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:12.439507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:12.446877 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:12.447371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:12.447868 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:12.448585 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:12.449069 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:12.449527 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:12.535025 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-95facd50-28f7-4cc3-814e-aec501c35a3b tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100210 Oct 03 13:36:12.535652 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 286/570] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 3 13:36:12 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:36:12.775431 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:12.776280 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:12.778306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:12.778967 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=10 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:12.785312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:12.785767 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:12.786331 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:12.787031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:12.787768 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:12.788196 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:12.926162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:12.934622 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-93d152bc-2508-4202-a7bd-182f70326b1e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.163013 Oct 03 13:36:12.935207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 285/571] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:12 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:13.713045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:13.718616 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-cfb2e92a-8bda-4bbd-a1d0-784b1d693a4e req-262eaf92-79ee-43b8-b0ea-942212ad80a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9b4c95-6c82-4aca-97eb-44eb954c5ca0", "tag": "a5a296ca-8101-49f0-b8d4-84e8c485eb14"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:13.728484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-cfb2e92a-8bda-4bbd-a1d0-784b1d693a4e req-262eaf92-79ee-43b8-b0ea-942212ad80a6 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:13.729048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-cfb2e92a-8bda-4bbd-a1d0-784b1d693a4e req-262eaf92-79ee-43b8-b0ea-942212ad80a6 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:13.729710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-cfb2e92a-8bda-4bbd-a1d0-784b1d693a4e req-262eaf92-79ee-43b8-b0ea-942212ad80a6 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:13.741474 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-cfb2e92a-8bda-4bbd-a1d0-784b1d693a4e req-262eaf92-79ee-43b8-b0ea-942212ad80a6 service nova] Creating event network-changed:a5a296ca-8101-49f0-b8d4-84e8c485eb14 for instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 on hv-cinder-86009 Oct 03 13:36:13.746856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-cfb2e92a-8bda-4bbd-a1d0-784b1d693a4e req-262eaf92-79ee-43b8-b0ea-942212ad80a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034847 Oct 03 13:36:13.747464 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 287/572] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:36:13.959952 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:13.961172 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:13.969019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:13.969539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:13.970212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:13.971141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:13.971832 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:13.972341 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:14.171342 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:14.180175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c135c2c5-7565-4496-b280-ab0ea84b29dc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.224239 Oct 03 13:36:14.180780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 286/573] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:13 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:15.207316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:15.208028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:15.214346 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:15.214837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:15.215287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:15.215985 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:15.216447 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:15.216909 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:15.348584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:15.357916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e32032df-7fa3-4efc-8305-d3fc16a5746e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.155448 Oct 03 13:36:15.358498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 288/574] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:15 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:16.381987 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:16.382668 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:16.390060 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:16.390561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:16.391001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:16.391692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:16.392147 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:16.392574 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:16.410878 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:16.523430 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:16.532188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eedc5da2-653b-4ae0-8b63-43c100076cb1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.154163 Oct 03 13:36:16.532774 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 287/575] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:16 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:17.557688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:17.558306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:17.564836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:17.565313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:17.565769 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:17.566451 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:17.566900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:17.567322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:17.699918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:17.708458 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a186ef8e-cad3-439c-86e5-6f3590f33bb8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1734 microversion: 2.1 time: 0.154639 Oct 03 13:36:17.709030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 289/576] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:17 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:18.732888 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:18.733508 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:18.740095 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:18.740573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:18.740998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:18.741741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:18.742212 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:18.742751 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:18.875693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:18.884133 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dae55884-7722-46f5-9151-0cd31f8722ed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1714 microversion: 2.1 time: 0.155774 Oct 03 13:36:18.885311 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 288/577] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:18 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:18.995441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:18.995939 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:19.002531 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:19.003009 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:19.003440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:19.004118 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:19.004566 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:19.004984 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:19.093349 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] HTTP exception thrown: Cannot 'detach_volume' instance 959d25e3-1620-4fb7-836c-7d55711fda46 while it is in vm_state rescued Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Request method failure captured: Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments/dba48e7f-e597-4b92-be26-2a04b4c37ff4 HTTP/1.1 Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQJ7dhZr3bTNwCRdkxpZcGfMZtRbPiQ_g8W8amBWRT5xBJBdaHowxgIwy1MxrAMeQWsTUDB6AoGe2ot7uPrIZ9qSg2baCmAomCZFfeGl0_o15iXO24ZajYZNt0VJksLAM0TMntentqEyhwpaffWXizyBY7hzYDtJDLRgaQhpHoZeEI Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:36:19.095050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: ae71fd7ba4334d0d813cbc0c06e3686e Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:36:19.096584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Cannot 'detach_volume' instance 959d25e3-1620-4fb7-836c-7d55711fda46 while it is in vm_state rescued Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'server_id': '959d25e3-1620-4fb7-836c-7d55711fda46', 'id': 'dba48e7f-e597-4b92-be26-2a04b4c37ff4'} Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 959d25e3-1620-4fb7-836c-7d55711fda46 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:36:19.097351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 959d25e3-1620-4fb7-836c-7d55711fda46 while it is in vm_state rescued Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 959d25e3-1620-4fb7-836c-7d55711fda46 while it is in vm_state rescued Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:36:19.098561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Returning 409 to user: Cannot 'detach_volume' instance 959d25e3-1620-4fb7-836c-7d55711fda46 while it is in vm_state rescued {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:36:19.099647 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-754e2fc6-ec07-44aa-8519-12e53015dae0 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "DELETE /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments/dba48e7f-e597-4b92-be26-2a04b4c37ff4" status: 409 len: 152 microversion: 2.1 time: 0.105161 Oct 03 13:36:19.099647 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 290/578] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:36:18 2022] DELETE /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments/dba48e7f-e597-4b92-be26-2a04b4c37ff4 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 03 13:36:19.105577 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:19.106117 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:19.112021 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:19.112503 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:19.112937 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:19.113702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:19.114157 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:19.114581 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:19.179997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4d3f69e9-34cd-4572-af83-9f9a81ae8bda tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "POST /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/action" status: 202 len: 0 microversion: 2.1 time: 0.078244 Oct 03 13:36:19.180627 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 289/579] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:36:19 2022] POST /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:36:19.190088 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:19.190712 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:19.197981 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:19.198544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:19.199008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:19.199699 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:19.200160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:19.200777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:19.339361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:19.347732 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a2f812bd-d4d3-4706-aaed-340d86242f39 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1722 microversion: 2.1 time: 0.161710 Oct 03 13:36:19.348307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 291/580] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:19 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:20.372281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:20.372972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:20.379412 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:20.379888 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:20.380319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:20.380996 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:20.381445 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:20.381885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:20.514324 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:20.525037 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1d06a4d6-3c61-4ddd-b6e1-7373d2c40acc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1722 microversion: 2.1 time: 0.157570 Oct 03 13:36:20.526272 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 290/581] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:20 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:21.549282 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:21.549969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:21.557423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:21.558068 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:21.558515 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:21.559226 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:21.559690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:21.560118 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:21.699720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:21.708753 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0203edac-9a9f-4c0e-afa9-24c0e5d9b501 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1722 microversion: 2.1 time: 0.163313 Oct 03 13:36:21.709346 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 292/582] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:21 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:21.984928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:21.985530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:21.991881 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:21.992370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:21.992801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:21.993517 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:21.994008 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:21.994433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:22.078935 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lazy-loading 'services' on Instance uuid 2ca377db-f0f6-4888-a94e-cfde65e470e9 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:36:22.150501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eddb35a1-2783-488b-bd99-9e11e1508bf2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/os-volume_attachments/f6098e5e-ee5b-46ab-91ab-684c176ac63e" status: 202 len: 0 microversion: 2.1 time: 0.169653 Oct 03 13:36:22.151196 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 291/583] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:36:21 2022] DELETE /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/os-volume_attachments/f6098e5e-ee5b-46ab-91ab-684c176ac63e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:36:22.733581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:22.734192 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:22.740718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:22.741195 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:22.741677 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:22.742366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:22.742819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:22.743240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:22.878771 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:22.887910 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-86620516-c9a7-4418-86c2-d755302f6430 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1728 microversion: 2.1 time: 0.158109 Oct 03 13:36:22.888406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 293/584] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:22 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:22.910732 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:22.911301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:22.917882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:22.918362 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:22.918793 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:22.919471 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:22.919916 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:22.920332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:22.996860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1dd6ab1a-8db2-452e-a72f-4c1e02b3000e tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090391 Oct 03 13:36:22.997463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 292/585] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 3 13:36:22 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:36:24.036906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-1b0587df-8a8b-4b8a-a105-b559be302e20 req-eb8eecd1-703c-4e78-b5c9-1616b647b9cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959d25e3-1620-4fb7-836c-7d55711fda46", "tag": "c4c1e4cd-a186-476e-9685-648d091500db"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:24.046696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-1b0587df-8a8b-4b8a-a105-b559be302e20 req-eb8eecd1-703c-4e78-b5c9-1616b647b9cb service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:24.047175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-1b0587df-8a8b-4b8a-a105-b559be302e20 req-eb8eecd1-703c-4e78-b5c9-1616b647b9cb service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:24.047603 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-1b0587df-8a8b-4b8a-a105-b559be302e20 req-eb8eecd1-703c-4e78-b5c9-1616b647b9cb service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:24.059470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-1b0587df-8a8b-4b8a-a105-b559be302e20 req-eb8eecd1-703c-4e78-b5c9-1616b647b9cb service nova] Creating event network-changed:c4c1e4cd-a186-476e-9685-648d091500db for instance 959d25e3-1620-4fb7-836c-7d55711fda46 on hv-cinder-86009 Oct 03 13:36:24.064722 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-1b0587df-8a8b-4b8a-a105-b559be302e20 req-eb8eecd1-703c-4e78-b5c9-1616b647b9cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160938 Oct 03 13:36:24.065702 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 294/586] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:36:24.333258 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-437eb0ee-c362-4c89-b8ba-b7f7d516b5cc tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:24.341647 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-437eb0ee-c362-4c89-b8ba-b7f7d516b5cc tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:24.342174 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-437eb0ee-c362-4c89-b8ba-b7f7d516b5cc tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:24.342614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-437eb0ee-c362-4c89-b8ba-b7f7d516b5cc tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:24.366475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-437eb0ee-c362-4c89-b8ba-b7f7d516b5cc tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Going to try to stop instance {{(pid=120743) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 03 13:36:24.414825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-437eb0ee-c362-4c89-b8ba-b7f7d516b5cc tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/action" status: 202 len: 0 microversion: 2.1 time: 0.085976 Oct 03 13:36:24.417591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 293/587] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:36:24 2022] POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:36:24.426400 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:24.427306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:24.438629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:24.440469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:24.441156 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:24.443479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:24.444366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:24.445092 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:24.606916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:24.615533 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8a239831-5682-4825-abf1-ecc1c887fae1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.194144 Oct 03 13:36:24.616389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 295/588] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:24 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:25.641538 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:25.642251 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:25.648900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:25.649386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:25.649854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:25.651183 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:25.651641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:25.652073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:25.785972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:25.794133 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1ce01623-0fba-4139-8430-166529bfa963 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.156837 Oct 03 13:36:25.794721 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 294/589] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:25 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:26.080666 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-32060409-c18b-4261-b3d5-72b8802d947b req-2a46503a-1862-4bc4-862b-d367210eb0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959d25e3-1620-4fb7-836c-7d55711fda46", "tag": "c4c1e4cd-a186-476e-9685-648d091500db"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:26.090645 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-32060409-c18b-4261-b3d5-72b8802d947b req-2a46503a-1862-4bc4-862b-d367210eb0b1 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:26.091127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-32060409-c18b-4261-b3d5-72b8802d947b req-2a46503a-1862-4bc4-862b-d367210eb0b1 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:26.091561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-32060409-c18b-4261-b3d5-72b8802d947b req-2a46503a-1862-4bc4-862b-d367210eb0b1 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:26.102832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-32060409-c18b-4261-b3d5-72b8802d947b req-2a46503a-1862-4bc4-862b-d367210eb0b1 service nova] Creating event network-changed:c4c1e4cd-a186-476e-9685-648d091500db for instance 959d25e3-1620-4fb7-836c-7d55711fda46 on hv-cinder-86009 Oct 03 13:36:26.108397 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-32060409-c18b-4261-b3d5-72b8802d947b req-2a46503a-1862-4bc4-862b-d367210eb0b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031095 Oct 03 13:36:26.109004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 296/590] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:36:26.817271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:26.818215 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:26.825316 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:26.825817 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:26.826258 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:26.826966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:26.827428 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:26.827861 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:26.969249 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:26.977875 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a9d0f4fd-16c1-4d5d-bab7-1b97bac8209b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.164446 Oct 03 13:36:26.978478 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 295/591] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:26 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:36:28.003411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:28.004115 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:28.011415 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:28.012206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:28.012748 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:28.013575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:28.014139 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:28.014575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:28.148966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:28.157480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6445e132-41c0-4846-9a2a-a8196a328686 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.158661 Oct 03 13:36:28.158060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 297/592] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:27 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:29.181293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:29.181944 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:29.189114 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:29.189646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:29.190091 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:29.190789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:29.191250 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:29.191674 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:29.320003 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:29.328372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-75263891-d4eb-4e2a-a3ac-edc5c934386c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.150987 Oct 03 13:36:29.328955 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 296/593] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:29 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:30.352232 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:30.352851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:30.359999 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:30.360480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:30.360922 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:30.361646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:30.362105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:30.362538 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:30.502659 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:30.510447 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-837d7a7c-c694-457c-be1e-88000e4a7adf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.162151 Oct 03 13:36:30.511045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 298/594] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:30 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:31.534406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:31.535022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:31.541462 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:31.541958 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:31.542390 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:31.543072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:31.543810 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:31.544332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:31.676783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:31.684870 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ca98ceed-10c5-4ab4-86cd-c2e0125465fa tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.154341 Oct 03 13:36:31.685446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 297/595] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:31 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:32.708133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:32.708751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:32.716229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:32.716790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:32.717232 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:32.717974 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:32.718433 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:32.718861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:32.862209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:32.869883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b71199fb-cdf6-4327-85ed-d5802d8934a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.165498 Oct 03 13:36:32.870745 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 299/596] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:32 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:33.894019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:33.894572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:33.901076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:33.901602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:33.902039 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:33.902725 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:33.903179 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:33.903603 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:34.038871 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:34.047744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-246837b4-95df-472c-a688-abdb22634733 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1677 microversion: 2.1 time: 0.157739 Oct 03 13:36:34.048317 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 298/597] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:33 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:35.071183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:35.071825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:35.078982 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:35.079474 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:35.079916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:35.080641 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:35.081095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:35.081548 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:35.216050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:35.223886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0cdcd7f0-6bcc-4f15-a39e-950e4157d0d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1654 microversion: 2.1 time: 0.156619 Oct 03 13:36:35.224468 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 300/598] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:35 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:35.246678 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-77df707f-da99-4edb-8eba-ba5b94cb5a1d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:36:35.254090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77df707f-da99-4edb-8eba-ba5b94cb5a1d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:35.254575 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77df707f-da99-4edb-8eba-ba5b94cb5a1d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:35.255018 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77df707f-da99-4edb-8eba-ba5b94cb5a1d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:35.277113 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-77df707f-da99-4edb-8eba-ba5b94cb5a1d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Going to try to start instance {{(pid=120743) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 03 13:36:35.321539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-77df707f-da99-4edb-8eba-ba5b94cb5a1d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/action" status: 202 len: 0 microversion: 2.1 time: 0.078556 Oct 03 13:36:35.322097 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 299/599] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:36:35 2022] POST /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:36:35.330790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:35.331410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:35.342052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:35.342568 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:35.342997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:35.344237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:35.344237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:35.344614 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:35.492059 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:35.501693 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cbf1e393-b54b-40ea-aec2-fdae05153f08 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1663 microversion: 2.1 time: 0.174759 Oct 03 13:36:35.502273 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 301/600] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:35 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:36.527310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:36.528549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:36.535296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:36.535790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:36.536402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:36.537364 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:36.537578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:36.537919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:36.687541 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:36.691098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:36.696123 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6e4f0324-226b-41b8-a22c-3ac57c3b020c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1663 microversion: 2.1 time: 0.173561 Oct 03 13:36:36.696697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 300/601] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:36 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1663 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:36:37.719327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:36:37.719977 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:36:37.726635 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:37.727126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:37.727568 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:37.728276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:36:37.728734 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:36:37.729168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:36:37.734457 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=100 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:36:37.865289 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:36:37.873369 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9d2963f0-d158-4dc2-9a47-268444bd6cb7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1667 microversion: 2.1 time: 0.158201 Oct 03 13:36:37.873979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 302/602] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:36:37 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:09.150554 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:09.151187 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:09.153024 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=41 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:09.159686 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:09.160164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:09.160591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:09.161273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:09.161753 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:09.162172 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:09.185525 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-991f31be-b81f-4af0-81a0-8793a61554e3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/ips" status: 200 len: 149 microversion: 2.1 time: 0.039807 Oct 03 13:37:09.186096 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 301/603] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:37:09 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:10.524639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c5e6bcd-1529-4a98-9df7-a07628522c1d"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:10.527048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:10.529115 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=39 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:10.530013 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:10.535566 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:10.536056 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:10.536500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:10.537209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:10.537711 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:10.538143 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:10.796777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c34bffc2-cb53-45cf-baf0-eb057def5da0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276065 Oct 03 13:37:10.798379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 303/604] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:37:10 2022] POST /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:11.441720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:11.442329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:11.448873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:11.449364 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:11.449853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:11.450550 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:11.451008 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:11.451436 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:11.539778 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lazy-loading 'services' on Instance uuid 959d25e3-1620-4fb7-836c-7d55711fda46 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:37:11.619435 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eb08e95d-a72a-4451-8c22-62ce576d1ed3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "DELETE /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments/dba48e7f-e597-4b92-be26-2a04b4c37ff4" status: 202 len: 0 microversion: 2.1 time: 0.181670 Oct 03 13:37:11.620092 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 302/605] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:37:11 2022] DELETE /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments/dba48e7f-e597-4b92-be26-2a04b4c37ff4 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:37:11.630201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:11.632770 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:11.639422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:11.639971 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:11.640402 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:11.641743 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:11.642220 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:11.643812 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:11.682363 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f5303537-ee4a-4386-937e-4b51843938e2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057373 Oct 03 13:37:11.683376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 304/606] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:11 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:12.697504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:12.699845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:12.706306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:12.706801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:12.707245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:12.707943 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:12.708401 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:12.708827 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:12.740472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f69977d7-b9e9-4954-b125-8848ba16893d tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047743 Oct 03 13:37:12.741039 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 303/607] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:12 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:13.753955 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:13.756189 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:13.762975 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:13.763470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:13.763920 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:13.764629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:13.765089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:13.765548 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:13.799397 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-eeab4e48-2017-4cf6-996f-8b61e8a1f525 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049718 Oct 03 13:37:13.800007 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 305/608] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:13 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:14.812776 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:14.815588 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:14.822133 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:14.822617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:14.823050 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:14.823737 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:14.824188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:14.824609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:14.855491 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e27cb5d8-39c8-4323-b7fb-4082c7c70363 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046938 Oct 03 13:37:14.856091 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 304/609] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:14 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:15.868665 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:15.870867 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:15.879571 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:15.880075 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:15.880572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:15.881327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:15.881840 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:15.882374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:15.917227 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9b2d0a8d-07d4-4cd0-9ced-64f86823f4cb tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052491 Oct 03 13:37:15.917779 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 306/610] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:15 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:16.931282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:16.933465 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:16.940928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:16.941476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:16.941931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:16.942702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:16.943157 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:16.943581 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:16.979047 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d84cd084-6114-4ad0-aee9-5976279d5988 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052407 Oct 03 13:37:16.979600 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 305/611] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:16 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:17.992397 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:17.994607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:18.001680 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:18.002279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:18.002725 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:18.003437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:18.003928 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:18.004364 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:18.037781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cb147472-435b-48c9-8afc-37b38f28edb5 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049328 Oct 03 13:37:18.038349 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 307/612] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:17 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:18.363904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c5e6bcd-1529-4a98-9df7-a07628522c1d"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:18.366408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:18.373314 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:18.374126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:18.374686 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:18.375254 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:18.375972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:18.376398 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:18.469714 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Invalid volume: volume 4c5e6bcd-1529-4a98-9df7-a07628522c1d is already attached to instances: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: POST /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments HTTP/1.1 Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 74 Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:37:18.472063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {"volumeAttachment": {"volumeId": "4c5e6bcd-1529-4a98-9df7-a07628522c1d"}} Oct 03 13:37:18.473811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Invalid volume: volume 4c5e6bcd-1529-4a98-9df7-a07628522c1d is already attached to instances: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'server_id': '0f9b4c95-6c82-4aca-97eb-44eb954c5ca0', 'body': {'volumeAttachment': {'volumeId': '4c5e6bcd-1529-4a98-9df7-a07628522c1d'}}} Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4c5e6bcd-1529-4a98-9df7-a07628522c1d is already attached to instances: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:18.474850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4c5e6bcd-1529-4a98-9df7-a07628522c1d is already attached to instances: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:18.476494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:18.478243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:18.478243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:37:18.478243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:37:18.478243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4c5e6bcd-1529-4a98-9df7-a07628522c1d is already attached to instances: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 Oct 03 13:37:18.478243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:18.478243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 400 to user: Invalid volume: volume 4c5e6bcd-1529-4a98-9df7-a07628522c1d is already attached to instances: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:37:18.478243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-737dbda4-0366-4f60-920f-dd2e1cfdb39e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113771 Oct 03 13:37:18.478243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 306/613] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:37:18 2022] POST /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:37:18.545330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:18.545856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:18.552106 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:18.552626 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:18.553024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:18.553741 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:18.554196 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:18.554613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:18.640615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lazy-loading 'services' on Instance uuid 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:37:18.717927 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-35417250-1856-4017-a86b-2e9e850d9abf tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments/4c5e6bcd-1529-4a98-9df7-a07628522c1d" status: 202 len: 0 microversion: 2.1 time: 0.176298 Oct 03 13:37:18.718533 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 308/614] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:37:18 2022] DELETE /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments/4c5e6bcd-1529-4a98-9df7-a07628522c1d => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:37:18.727609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:18.729767 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:18.736801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:18.737282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:18.737751 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:18.738517 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:18.738968 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:18.739401 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:18.775613 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2538f5df-4858-4ff8-b48e-9f6d7e6d4ca1 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052336 Oct 03 13:37:18.776184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 307/615] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:18 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:19.052576 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:19.054768 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:19.061201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:19.061735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:19.062185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:19.062896 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:19.063352 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:19.063780 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:19.095437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c910f622-bd6e-48fa-bb98-664e90438fed tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048698 Oct 03 13:37:19.096417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 309/616] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:19 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:37:19.185024 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:19.185582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:19.193008 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:19.193526 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:19.193965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:19.194664 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:19.195115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:19.195539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:19.221699 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:37:19.303920 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e7d2ec9c-346e-4b7d-878f-64ae370f5084 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "DELETE /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 204 len: 0 microversion: 2.1 time: 0.122382 Oct 03 13:37:19.304432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 308/617] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:37:19 2022] DELETE /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:37:19.312695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:19.313316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:19.319672 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:19.320167 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:19.320612 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:19.321320 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:19.321932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:19.322363 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:19.467405 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:19.475697 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c862629b-99ee-42e5-83ca-5bce3640ed32 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1688 microversion: 2.1 time: 0.167089 Oct 03 13:37:19.476275 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 310/618] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:19 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:19.789160 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:19.791410 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:19.797891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:19.798896 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:19.799373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:19.800072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:19.800524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:19.800951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:19.832968 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-83e7018e-79ea-4600-8359-c437ac98c60d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048139 Oct 03 13:37:19.833645 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 309/619] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:19 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:20.499679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:20.500288 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:20.507313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:20.507798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:20.508235 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:20.508956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:20.509410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:20.509862 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:20.648355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:20.656259 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a84d505e-4bc4-4d93-8270-dfe75d6a86c3 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1688 microversion: 2.1 time: 0.160418 Oct 03 13:37:20.656835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 311/620] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:20 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:20.845841 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:20.848107 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:20.854702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:20.855193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:20.855632 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:20.856332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:20.856791 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:20.857222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:20.888092 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-17701150-9fa5-46be-b5ff-0420377183d0 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Oct 03 13:37:20.888672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 310/621] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:20 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:21.681940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:21.682611 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:21.689130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:21.689720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:21.690170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:21.690887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:21.691341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:21.691763 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:21.843258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:21.852274 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d5f110a6-b0d9-4196-81f8-2477e56cbab4 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1688 microversion: 2.1 time: 0.174096 Oct 03 13:37:21.852849 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 312/622] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:21 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:21.901201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:21.903369 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:21.910608 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:21.911102 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:21.911541 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:21.912253 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:21.912706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:21.913130 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:21.943457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-106e7a1d-b60c-4fd1-a6a8-160e95a79daa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046875 Oct 03 13:37:21.944027 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 311/623] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:21 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:22.877756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:22.878400 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:22.884726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:22.885238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:22.885704 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:22.886389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:22.886836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:22.887262 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:22.960155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:22.962346 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:22.968958 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:22.969440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:22.969927 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:22.970620 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:22.971105 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:22.971483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:23.004372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c4505a91-7b84-4dfd-8f5a-e8310807c48d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048179 Oct 03 13:37:23.004961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 312/624] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:22 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:37:23.022131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:23.029790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-159da8e6-165b-4607-b5d8-94633520dc50 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1688 microversion: 2.1 time: 0.156910 Oct 03 13:37:23.030366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 313/625] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:22 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:24.016800 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:24.019806 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:24.026351 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.026844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.027286 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.027995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.028453 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.028880 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.054050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:24.054663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:24.062327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.062554 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-53551279-3ef1-40d1-82ff-99f13134d9b9 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049730 Oct 03 13:37:24.063242 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.063418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 313/626] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:24 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:37:24.069520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.070335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.070830 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.071570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.136987 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:24.137625 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:24.145644 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.146134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.146777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.147796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.148264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.148696 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.180690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:37:24.213554 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:24.239220 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:24.248161 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-07c69d37-b818-4eaf-95c9-6c0310ceddde tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1688 microversion: 2.1 time: 0.197922 Oct 03 13:37:24.265066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 314/627] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:24 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:37:24.274119 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d4066ed0-adf2-4007-9182-259b5d9e3f3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 204 len: 0 microversion: 2.1 time: 0.140356 Oct 03 13:37:24.274920 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 314/628] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:37:24 2022] DELETE /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 03 13:37:24.283210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:24.283921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:24.290203 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.290689 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.291130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.291848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.292281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.292705 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.441225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:24.450051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-eaf4b8aa-9a09-4938-9542-ae41fd26bbd4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1679 microversion: 2.1 time: 0.171006 Oct 03 13:37:24.450655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 315/629] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:24 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:24.698694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-8df171f5-9bf4-41d6-b49d-3bca5cc6edf0 req-347c0036-5e5e-47be-9344-b2cb12051924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959d25e3-1620-4fb7-836c-7d55711fda46", "name": "network-vif-deleted", "tag": "c4c1e4cd-a186-476e-9685-648d091500db"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:24.712514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8df171f5-9bf4-41d6-b49d-3bca5cc6edf0 req-347c0036-5e5e-47be-9344-b2cb12051924 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:24.713613 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8df171f5-9bf4-41d6-b49d-3bca5cc6edf0 req-347c0036-5e5e-47be-9344-b2cb12051924 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:24.714516 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8df171f5-9bf4-41d6-b49d-3bca5cc6edf0 req-347c0036-5e5e-47be-9344-b2cb12051924 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:24.735107 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-8df171f5-9bf4-41d6-b49d-3bca5cc6edf0 req-347c0036-5e5e-47be-9344-b2cb12051924 service nova] Creating event network-vif-deleted:c4c1e4cd-a186-476e-9685-648d091500db for instance 959d25e3-1620-4fb7-836c-7d55711fda46 on hv-cinder-86009 Oct 03 13:37:24.741201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-8df171f5-9bf4-41d6-b49d-3bca5cc6edf0 req-347c0036-5e5e-47be-9344-b2cb12051924 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046553 Oct 03 13:37:24.741857 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 315/630] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:25.273153 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:25.273865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:25.280519 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:25.281009 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:25.281463 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:25.282183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:25.282711 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:25.283438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:25.357142 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:25.365821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-57c5924e-4243-4076-a33c-82f924408dc2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1620 microversion: 2.1 time: 0.096411 Oct 03 13:37:25.366438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 316/631] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:25 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1620 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:25.475621 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:25.476335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:25.483382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:25.483998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:25.484446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:25.485170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:25.485677 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:25.486110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:25.652372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:25.667353 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6f063cd4-9a57-4f7d-83e0-e27999ccf731 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1679 microversion: 2.1 time: 0.196004 Oct 03 13:37:25.668471 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 316/632] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:25 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:26.390678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:26.391291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:26.397923 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:26.398437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:26.399073 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:26.399772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:26.400227 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:26.400655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:26.419634 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:26.436276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:26.436700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:26.437133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:26.437602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lazy-loading 'fault' on Instance uuid 959d25e3-1620-4fb7-836c-7d55711fda46 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:37:26.479852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:26.488710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d14d2805-90d0-4ea7-b710-4789cad85c76 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 200 len: 1334 microversion: 2.1 time: 0.101790 Oct 03 13:37:26.489312 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 317/633] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:26 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:26.708658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:26.709287 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:26.717157 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:26.717676 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:26.718118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:26.718825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:26.719283 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:26.719713 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:26.924711 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:26.932476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-28f99615-c367-4eee-9c16-a07d34ca39f5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1679 microversion: 2.1 time: 0.228588 Oct 03 13:37:26.932999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 317/634] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:26 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:27.234435 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-7e666dd2-c7d6-4977-a8b1-a8a7a3d278ac req-8003214f-cf43-484c-8f25-cff007d13021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9b4c95-6c82-4aca-97eb-44eb954c5ca0", "name": "network-vif-deleted", "tag": "a5a296ca-8101-49f0-b8d4-84e8c485eb14"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:27.244679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-7e666dd2-c7d6-4977-a8b1-a8a7a3d278ac req-8003214f-cf43-484c-8f25-cff007d13021 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:27.245162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-7e666dd2-c7d6-4977-a8b1-a8a7a3d278ac req-8003214f-cf43-484c-8f25-cff007d13021 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:27.245638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-7e666dd2-c7d6-4977-a8b1-a8a7a3d278ac req-8003214f-cf43-484c-8f25-cff007d13021 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:27.258549 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-7e666dd2-c7d6-4977-a8b1-a8a7a3d278ac req-8003214f-cf43-484c-8f25-cff007d13021 service nova] Creating event network-vif-deleted:a5a296ca-8101-49f0-b8d4-84e8c485eb14 for instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 on hv-cinder-86009 Oct 03 13:37:27.263915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-7e666dd2-c7d6-4977-a8b1-a8a7a3d278ac req-8003214f-cf43-484c-8f25-cff007d13021 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033049 Oct 03 13:37:27.268372 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 318/635] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:37:27.513600 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:27.514228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 959d25e3-1620-4fb7-836c-7d55711fda46] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:27.521188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:27.521854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:27.527771 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:27.528556 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:27.529029 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:27.529688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:27.547100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] HTTP exception thrown: Instance 959d25e3-1620-4fb7-836c-7d55711fda46 could not be found. Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Request method failure captured: Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 HTTP/1.1 Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQJ7dhZr3bTNwCRdkxpZcGfMZtRbPiQ_g8W8amBWRT5xBJBdaHowxgIwy1MxrAMeQWsTUDB6AoGe2ot7uPrIZ9qSg2baCmAomCZFfeGl0_o15iXO24ZajYZNt0VJksLAM0TMntentqEyhwpaffWXizyBY7hzYDtJDLRgaQhpHoZeEI Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:37:27.549860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: ae71fd7ba4334d0d813cbc0c06e3686e Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 959d25e3-1620-4fb7-836c-7d55711fda46 could not be found. Oct 03 13:37:27.552404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '959d25e3-1620-4fb7-836c-7d55711fda46'} Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959d25e3-1620-4fb7-836c-7d55711fda46 could not be found. Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:37:27.554290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959d25e3-1620-4fb7-836c-7d55711fda46 could not be found. Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959d25e3-1620-4fb7-836c-7d55711fda46 could not be found. Oct 03 13:37:27.556736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:27.559338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Returning 404 to user: Instance 959d25e3-1620-4fb7-836c-7d55711fda46 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:37:27.559338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6f7005b3-ff10-4bbb-a248-336acfa69ecc tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46" status: 404 len: 111 microversion: 2.1 time: 0.041796 Oct 03 13:37:27.566581 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 318/636] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:27 2022] GET /compute/v2.1/servers/959d25e3-1620-4fb7-836c-7d55711fda46 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:37:27.568094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d6e975af-4167-4300-b28b-42a3ca21dd59 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '.version_select at 0x7f7c21976d30>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:27.589977 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d6e975af-4167-4300-b28b-42a3ca21dd59 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66205088" status: 202 len: 0 microversion: 2.1 time: 0.030025 Oct 03 13:37:27.592222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 319/637] 10.222.0.58 () {58 vars in 1215 bytes} [Mon Oct 3 13:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66205088 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:37:27.967609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:27.971828 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:27.981343 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:27.982396 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:27.982919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:27.986001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:27.987264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:27.987918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:28.041172 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:28.041898 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:28.042956 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:28.043571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lazy-loading 'fault' on Instance uuid 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:37:28.123971 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:28.133612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-115d61c9-abc6-471f-9bae-0625c5bf7167 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 200 len: 1330 microversion: 2.1 time: 0.178134 Oct 03 13:37:28.134527 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 319/638] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:27 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 1330 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:29.160138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:29.160913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:29.168064 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:29.168560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:29.169005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:29.169775 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:29.170282 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:29.170710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:29.185217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 HTTP/1.1 Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:37:29.186940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:37:29.188445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '0f9b4c95-6c82-4aca-97eb-44eb954c5ca0'} Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:37:29.189805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:37:29.191393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:29.192674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:37:29.192674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b430bdb3-2d8d-4457-acd5-6c0d975bb20e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 404 len: 111 microversion: 2.1 time: 0.032865 Oct 03 13:37:29.192674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 320/639] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:29 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:37:29.202018 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d0e9cd70-29a3-48fd-909b-f06374ef76da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '.version_select at 0x7f7c21d94310>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:29.229028 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d0e9cd70-29a3-48fd-909b-f06374ef76da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843650383" status: 202 len: 0 microversion: 2.1 time: 0.033744 Oct 03 13:37:29.229866 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 320/640] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Oct 3 13:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843650383 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:37:29.920751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ab0a45e2-1442-473e-932c-cf97881f96c2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: .version_select at 0x7f7c2190bdc0>, body: {"keypair": {"name": "tempest-keypair-887261099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJSsW5GOX0j19qyZHBMg8jIfNeeSUcwWLls/yiEne8KX2BHNRuqSsbT5ryuxPbudv79rnMMCgqU51kU4INVffMcENGQfzUpCw/5+w8HSt95Yhnx70y6L8hSxkFqQLmtCw=="}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:29.938292 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-ab0a45e2-1442-473e-932c-cf97881f96c2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:37:29.942643 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-ab0a45e2-1442-473e-932c-cf97881f96c2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for user 98de1ccbabc64162a29cbce2cfe11600 and project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:37:29.964772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ab0a45e2-1442-473e-932c-cf97881f96c2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048060 Oct 03 13:37:29.965375 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 321/641] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:37:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:30.650233 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:30.651347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:30.658896 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:30.659373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:30.659801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:30.660493 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:30.660941 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:30.662030 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:30.686882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:37:30.768143 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0cfe6f24-bea0-4ce2-a741-fe506a8a6304 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 204 len: 0 microversion: 2.1 time: 0.120798 Oct 03 13:37:30.769587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 321/642] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:37:30 2022] DELETE /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:37:30.778387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:30.779035 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:30.786847 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:30.787350 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:30.787798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:30.788513 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:30.788971 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:30.789408 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:31.004655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:31.012592 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-96a34c85-393e-4244-9506-c58f71e0074f tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1508 microversion: 2.1 time: 0.238885 Oct 03 13:37:31.013353 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 322/643] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:30 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:31.328172 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1747054119", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff8319e2-24e1-46c8-a6e2-568f9c4503d6"}], "security_groups": [{"name": "tempest-securitygroup--2034877516"}], "key_name": "tempest-keypair-887261099", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:31.437758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] validate_networks() for [('ff8319e2-24e1-46c8-a6e2-568f9c4503d6', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:37:31.822692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:37:31.823266 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:37:31.823608 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:37:31.824011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:37:31.824415 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:37:31.833363 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:31.833871 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:31.834301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:31.835026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:31.835478 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:31.835902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:31.854450 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:37:31.859816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Getting quotas for user 98de1ccbabc64162a29cbce2cfe11600 and project d8e6dd58ff43419fa5b945bd08ef2931. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:37:31.872987 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:37:31.875733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:37:31.922872 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ae1f447b-b425-479b-907c-73641a7eccc5 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.599385 Oct 03 13:37:31.924068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 322/644] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:37:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:37:31.935702 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-01eabf1e-a7a7-4e33-82df-b88a4c9348cc tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:31.936488 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-01eabf1e-a7a7-4e33-82df-b88a4c9348cc tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:31.991281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-01eabf1e-a7a7-4e33-82df-b88a4c9348cc tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:31.998191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-01eabf1e-a7a7-4e33-82df-b88a4c9348cc tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1241 microversion: 2.1 time: 0.066346 Oct 03 13:37:31.998761 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 323/645] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:31 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:32.036507 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:32.037110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:32.043944 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:32.044426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:32.044860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:32.045593 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:32.046044 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:32.046464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:32.194468 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:32.202406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-daf23b0b-68eb-45f7-8556-44c7792a95cd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1508 microversion: 2.1 time: 0.170272 Oct 03 13:37:32.203227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 323/646] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:32 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:32.640335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-115cf787-180f-423a-9bf8-fadd3202124b req-e7e0421b-4f33-473f-82e9-53b32bd19597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46d2be3-6cca-411b-8b83-b13d51f53463", "name": "network-vif-deleted", "tag": "9b784b63-7dc9-4c53-835b-6c3039d2f205"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:32.651499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-115cf787-180f-423a-9bf8-fadd3202124b req-e7e0421b-4f33-473f-82e9-53b32bd19597 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:32.652004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-115cf787-180f-423a-9bf8-fadd3202124b req-e7e0421b-4f33-473f-82e9-53b32bd19597 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:32.652467 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-115cf787-180f-423a-9bf8-fadd3202124b req-e7e0421b-4f33-473f-82e9-53b32bd19597 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:32.665140 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-115cf787-180f-423a-9bf8-fadd3202124b req-e7e0421b-4f33-473f-82e9-53b32bd19597 service nova] Creating event network-vif-deleted:9b784b63-7dc9-4c53-835b-6c3039d2f205 for instance f46d2be3-6cca-411b-8b83-b13d51f53463 on hv-cinder-86009 Oct 03 13:37:32.671061 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-115cf787-180f-423a-9bf8-fadd3202124b req-e7e0421b-4f33-473f-82e9-53b32bd19597 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034388 Oct 03 13:37:32.671672 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 324/647] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:33.022945 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-730f70b5-8193-489d-8393-24cc6c92fad3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:33.024457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-730f70b5-8193-489d-8393-24cc6c92fad3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:33.084281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-730f70b5-8193-489d-8393-24cc6c92fad3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:33.091790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-730f70b5-8193-489d-8393-24cc6c92fad3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1241 microversion: 2.1 time: 0.075481 Oct 03 13:37:33.092312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 324/648] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:33 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:33.227390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:33.228130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:33.234281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:33.234817 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:33.235268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:33.236524 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:33.237693 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:33.238314 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:33.271209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:33.271698 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:33.272201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:33.272657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lazy-loading 'fault' on Instance uuid f46d2be3-6cca-411b-8b83-b13d51f53463 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:37:33.319602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:33.326540 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-92ab93a7-a930-47c1-bd78-bd326f893269 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 200 len: 1312 microversion: 2.1 time: 0.103868 Oct 03 13:37:33.327132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 325/649] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:33 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:34.114332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2a1a093d-1489-4e36-b662-38915bb4461e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:34.114953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2a1a093d-1489-4e36-b662-38915bb4461e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:34.180947 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2a1a093d-1489-4e36-b662-38915bb4461e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:34.188218 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2a1a093d-1489-4e36-b662-38915bb4461e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1241 microversion: 2.1 time: 0.077797 Oct 03 13:37:34.188806 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 325/650] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:34 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:34.349410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:34.350064 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: f46d2be3-6cca-411b-8b83-b13d51f53463] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:34.356935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:34.357422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:34.358122 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:34.358833 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:34.359295 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:34.359765 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:34.374166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] HTTP exception thrown: Instance f46d2be3-6cca-411b-8b83-b13d51f53463 could not be found. Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Request method failure captured: Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 HTTP/1.1 Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQJ7dhZr3bTNwCRdkxpZcGfMZtRbPiQ_g8W8amBWRT5xBJBdaHowxgIwy1MxrAMeQWsTUDB6AoGe2ot7uPrIZ9qSg2baCmAomCZFfeGl0_o15iXO24ZajYZNt0VJksLAM0TMntentqEyhwpaffWXizyBY7hzYDtJDLRgaQhpHoZeEI Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:37:34.376132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: ae71fd7ba4334d0d813cbc0c06e3686e Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance f46d2be3-6cca-411b-8b83-b13d51f53463 could not be found. Oct 03 13:37:34.378026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': 'f46d2be3-6cca-411b-8b83-b13d51f53463'} Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f46d2be3-6cca-411b-8b83-b13d51f53463 could not be found. Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:37:34.378764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f46d2be3-6cca-411b-8b83-b13d51f53463 could not be found. Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f46d2be3-6cca-411b-8b83-b13d51f53463 could not be found. Oct 03 13:37:34.380085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:34.381633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Returning 404 to user: Instance f46d2be3-6cca-411b-8b83-b13d51f53463 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:37:34.381633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-131f3973-e148-4110-8e86-6c0feeba29e1 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463" status: 404 len: 111 microversion: 2.1 time: 0.032517 Oct 03 13:37:34.381633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 326/651] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:34 2022] GET /compute/v2.1/servers/f46d2be3-6cca-411b-8b83-b13d51f53463 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:37:34.388532 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:34.389038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:34.396802 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:34.397287 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:34.397746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:34.398445 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:34.398894 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:34.399318 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:34.425126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:37:34.499275 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:34.506339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-86e43569-7027-4c10-b154-7c51365108c2 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 204 len: 0 microversion: 2.1 time: 0.122301 Oct 03 13:37:34.507044 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 326/652] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:37:34 2022] DELETE /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:37:34.519651 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:34.520309 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:34.532000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:34.532499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:34.532945 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:34.533760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:34.534230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:34.534775 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:34.679271 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:34.687060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-67abef90-220a-4a59-acfc-d4cdd6c457fd tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.175080 Oct 03 13:37:34.687624 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 327/653] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:34 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:35.214011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-475511d2-0f1a-4ff0-b61c-01ff521d29ad tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:35.214712 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-475511d2-0f1a-4ff0-b61c-01ff521d29ad tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:35.273704 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-475511d2-0f1a-4ff0-b61c-01ff521d29ad tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:35.281109 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-475511d2-0f1a-4ff0-b61c-01ff521d29ad tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1241 microversion: 2.1 time: 0.071201 Oct 03 13:37:35.281731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 327/654] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:35 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:35.710473 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:35.711117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:35.717661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:35.718148 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:35.718591 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:35.719285 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:35.719737 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:35.720165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:35.853946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:35.862390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3ea8fb34-b044-4d23-8005-1e3c6285d6db tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.155130 Oct 03 13:37:35.863008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 328/655] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:35 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:36.304255 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:36.304897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:36.313088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:36.313667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:36.314104 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:36.314864 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:36.315329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:36.315748 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:36.377885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:36.385918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bb22bfed-0fb3-4f81-9899-331974c4325d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1245 microversion: 2.1 time: 0.085411 Oct 03 13:37:36.386945 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 328/656] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:36 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:36.885476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:36.886116 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:36.892597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:36.893266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:36.893735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:36.894440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:36.894901 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:36.895333 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:37.030789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:37.038895 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cf278c6f-bb7c-4352-8b30-dac3c47a7185 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.157292 Oct 03 13:37:37.039460 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 329/657] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:36 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:37.410966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:37.411623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:37.418378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:37.419141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:37.419777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:37.420699 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:37.421355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:37.422560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:37.803890 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:37.812054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b337961a-4934-4c16-b169-61ae0b801299 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1301 microversion: 2.1 time: 0.405916 Oct 03 13:37:37.812654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 329/658] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:37 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1301 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:38.063775 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:38.064551 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:38.067547 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:37:38.067717 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Mon Oct 3 13:37:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 (ip 10.222.0.58) !!! Oct 03 13:37:38.080379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:38.082023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:38.082484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:38.083252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:38.083695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:38.084130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:38.230956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae71fd7ba4334d0d813cbc0c06e3686e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557321bf33ca42df8d5d53e5157e6803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:38.242360 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a4517c41-5f7c-4298-a209-0078282f79ff tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 200 len: 1523 microversion: 2.1 time: 0.182336 Oct 03 13:37:38.243427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 330/659] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:38 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:38.305662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-7c6f569e-c9f9-486c-9f1b-8992eb206d94 req-fd346c91-ecc7-4138-b193-cff3ca7955b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7a7e49-20a7-45bc-bc98-7af878fc50a8", "name": "network-vif-deleted", "tag": "4e8541e0-b0c3-4cae-a985-b4e2dfec4290"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:38.319225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7c6f569e-c9f9-486c-9f1b-8992eb206d94 req-fd346c91-ecc7-4138-b193-cff3ca7955b6 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:38.319881 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7c6f569e-c9f9-486c-9f1b-8992eb206d94 req-fd346c91-ecc7-4138-b193-cff3ca7955b6 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:38.320318 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7c6f569e-c9f9-486c-9f1b-8992eb206d94 req-fd346c91-ecc7-4138-b193-cff3ca7955b6 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:38.334574 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-7c6f569e-c9f9-486c-9f1b-8992eb206d94 req-fd346c91-ecc7-4138-b193-cff3ca7955b6 service nova] Creating event network-vif-deleted:4e8541e0-b0c3-4cae-a985-b4e2dfec4290 for instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 on hv-cinder-86009 Oct 03 13:37:38.339935 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-7c6f569e-c9f9-486c-9f1b-8992eb206d94 req-fd346c91-ecc7-4138-b193-cff3ca7955b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038166 Oct 03 13:37:38.340558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 330/660] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:38.837361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:38.838061 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:38.844889 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:38.845574 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:38.846389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:38.847455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:38.848132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:38.848639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:39.003603 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:39.015460 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ab6ff1a4-b826-4a87-b28c-9ad251808483 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1367 microversion: 2.1 time: 0.182190 Oct 03 13:37:39.016225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 331/661] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:38 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:39.268617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:39.269349 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] [instance: 4b7a7e49-20a7-45bc-bc98-7af878fc50a8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:39.276116 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:39.276603 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:39.277041 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:39.277760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:39.278210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:39.278674 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:39.294046 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] HTTP exception thrown: Instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 could not be found. Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Request method failure captured: Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 HTTP/1.1 Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQJ7dhZr3bTNwCRdkxpZcGfMZtRbPiQ_g8W8amBWRT5xBJBdaHowxgIwy1MxrAMeQWsTUDB6AoGe2ot7uPrIZ9qSg2baCmAomCZFfeGl0_o15iXO24ZajYZNt0VJksLAM0TMntentqEyhwpaffWXizyBY7hzYDtJDLRgaQhpHoZeEI Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:37:39.295726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/557321bf33ca42df8d5d53e5157e6803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 557321bf33ca42df8d5d53e5157e6803 Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071066128 Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: ae71fd7ba4334d0d813cbc0c06e3686e Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071066128-project Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 could not be found. Oct 03 13:37:39.297088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '4b7a7e49-20a7-45bc-bc98-7af878fc50a8'} Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 could not be found. Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:37:39.297868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 could not be found. Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 could not be found. Oct 03 13:37:39.299031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:37:39.300504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] Returning 404 to user: Instance 4b7a7e49-20a7-45bc-bc98-7af878fc50a8 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:37:39.300504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7f0ad445-936a-4cbb-9871-9737877379f8 tempest-ServerRescueNegativeTestJSON-1071066128 tempest-ServerRescueNegativeTestJSON-1071066128-project] 10.222.0.58 "GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8" status: 404 len: 111 microversion: 2.1 time: 0.033348 Oct 03 13:37:39.300504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 331/662] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:39 2022] GET /compute/v2.1/servers/4b7a7e49-20a7-45bc-bc98-7af878fc50a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:37:40.040243 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:40.040769 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:40.047872 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:40.048365 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:40.048826 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:40.050318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:40.050966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:40.051394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:40.279127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:40.287962 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3625f1f3-29a5-4aa1-a14c-9ed05c54df3a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1367 microversion: 2.1 time: 0.251649 Oct 03 13:37:40.288665 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 332/663] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:40 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:40.358162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-a29a6768-bdad-43b4-a252-655eb6e8ea35 req-acd40a93-4c1d-40fd-a8ec-4bbb9f851463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a4790f-1fa2-4b82-a496-f6d5083042e3", "tag": "1f9b1a68-4136-4ee8-9212-584268a6798e"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:40.368853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a29a6768-bdad-43b4-a252-655eb6e8ea35 req-acd40a93-4c1d-40fd-a8ec-4bbb9f851463 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:40.369335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a29a6768-bdad-43b4-a252-655eb6e8ea35 req-acd40a93-4c1d-40fd-a8ec-4bbb9f851463 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:40.369796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a29a6768-bdad-43b4-a252-655eb6e8ea35 req-acd40a93-4c1d-40fd-a8ec-4bbb9f851463 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:40.387255 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-a29a6768-bdad-43b4-a252-655eb6e8ea35 req-acd40a93-4c1d-40fd-a8ec-4bbb9f851463 service nova] Creating event network-changed:1f9b1a68-4136-4ee8-9212-584268a6798e for instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 on hv-cinder-86009 Oct 03 13:37:40.391836 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-a29a6768-bdad-43b4-a252-655eb6e8ea35 req-acd40a93-4c1d-40fd-a8ec-4bbb9f851463 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037331 Oct 03 13:37:40.392437 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 332/664] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:41.312610 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:41.313388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:41.320175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:41.322470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:41.323437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:41.324259 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:41.325596 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:41.326262 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:41.326863 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:41.646417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:41.655961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ab7ba51c-1a7b-4a72-9c65-15f7c430608a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1367 microversion: 2.1 time: 0.347396 Oct 03 13:37:41.657573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 333/665] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:41 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:41.699447 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:41.703670 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:41.726710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:41.727488 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:41.728250 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:41.729306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:41.729953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:41.732297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:41.775539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d3cff5b9-9808-4187-9023-f27f7babd019 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087328 Oct 03 13:37:41.776134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 333/666] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:37:41 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:37:41.862725 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:41.863320 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:41.869522 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:41.870087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:41.870626 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:41.871527 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:41.871989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:41.872453 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:41.903598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:37:41.994712 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b108b871-8311-483a-b99e-7f938cd43e5c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 204 len: 0 microversion: 2.1 time: 0.136374 Oct 03 13:37:41.996207 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 334/667] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:37:41 2022] DELETE /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:37:42.006330 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:42.007321 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:42.010694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:42.016768 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:42.017945 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:42.018742 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:42.019655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:42.020132 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:42.020553 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:42.157999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:42.162395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:42.172970 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-68be8b24-9305-45d0-91e2-a9462e3bcfc6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1673 microversion: 2.1 time: 0.167933 Oct 03 13:37:42.185479 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 334/668] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:41 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:42.680819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:42.681565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:42.683553 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=6 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:42.692113 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:42.692696 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:42.693196 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:42.693923 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:42.694395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:42.694830 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:42.841158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:42.850470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c0991e3d-73f1-45be-86ce-f671324f9320 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1367 microversion: 2.1 time: 0.172972 Oct 03 13:37:42.858266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 335/669] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:42 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:43.204418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:43.205701 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:43.213675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:43.214166 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:43.214602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:43.215335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:43.215786 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:43.216614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:43.363531 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:43.382027 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e3f52b83-8111-4791-8832-4b9713a315d2 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1673 microversion: 2.1 time: 0.181414 Oct 03 13:37:43.382985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 335/670] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:43 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:43.876192 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:43.876830 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:43.884496 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:43.884989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:43.885663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:43.886372 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:43.886839 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:43.887319 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:44.066478 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:44.074867 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-10ba2b67-ae9a-45f9-94eb-808a1308c0db tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1367 microversion: 2.1 time: 0.204066 Oct 03 13:37:44.075782 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 336/671] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:43 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:44.414122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:44.415166 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:44.423679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:44.423679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:44.423679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:44.424554 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:44.425119 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:44.425788 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:44.599347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:44.607395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-90075ed2-8a14-4c20-994c-1bbdb15f3875 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1673 microversion: 2.1 time: 0.202268 Oct 03 13:37:44.608950 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 336/672] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:44 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:45.099506 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:45.100281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:45.117267 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:45.120669 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:45.121899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:45.124578 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:45.130005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:45.131147 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:45.178987 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:45.520348 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:45.531968 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d1b2a9ce-2ade-46dd-8f8b-a349cceebc71 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1367 microversion: 2.1 time: 0.437144 Oct 03 13:37:45.534663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 337/673] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:45 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:45.635991 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:45.638395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:45.641230 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=12 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:37:45.649652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:45.650649 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:45.651453 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:45.652403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:45.653079 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:45.653768 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:45.809308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:45.819931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b9985926-1f24-4edd-8df1-61681828253f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 200 len: 1605 microversion: 2.1 time: 0.189785 Oct 03 13:37:45.820871 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 337/674] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:45 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 1605 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:45.998842 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-8ac81230-0f1e-48f3-9d38-63efa61d4a92 req-5c3887cd-fc24-47b0-a777-986174379148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca377db-f0f6-4888-a94e-cfde65e470e9", "name": "network-vif-deleted", "tag": "b7b4c568-efe4-4d19-8923-b411916ba1a1"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:46.024553 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8ac81230-0f1e-48f3-9d38-63efa61d4a92 req-5c3887cd-fc24-47b0-a777-986174379148 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:46.026883 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8ac81230-0f1e-48f3-9d38-63efa61d4a92 req-5c3887cd-fc24-47b0-a777-986174379148 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:46.027751 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-8ac81230-0f1e-48f3-9d38-63efa61d4a92 req-5c3887cd-fc24-47b0-a777-986174379148 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:46.044408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-8ac81230-0f1e-48f3-9d38-63efa61d4a92 req-5c3887cd-fc24-47b0-a777-986174379148 service nova] Creating event network-vif-deleted:b7b4c568-efe4-4d19-8923-b411916ba1a1 for instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 on hv-cinder-86009 Oct 03 13:37:46.071520 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-8ac81230-0f1e-48f3-9d38-63efa61d4a92 req-5c3887cd-fc24-47b0-a777-986174379148 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077788 Oct 03 13:37:46.075477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 338/675] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:37:46.244566 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-ed9e0177-5d9e-4c2f-b206-f2e42d92f1f8 req-2dd78695-1557-4cd7-b8e7-a863a46353f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a4790f-1fa2-4b82-a496-f6d5083042e3", "name": "network-vif-plugged", "status": "completed", "tag": "1f9b1a68-4136-4ee8-9212-584268a6798e"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:46.261872 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ed9e0177-5d9e-4c2f-b206-f2e42d92f1f8 req-2dd78695-1557-4cd7-b8e7-a863a46353f7 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:46.262665 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ed9e0177-5d9e-4c2f-b206-f2e42d92f1f8 req-2dd78695-1557-4cd7-b8e7-a863a46353f7 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:46.263274 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ed9e0177-5d9e-4c2f-b206-f2e42d92f1f8 req-2dd78695-1557-4cd7-b8e7-a863a46353f7 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:46.297492 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-ed9e0177-5d9e-4c2f-b206-f2e42d92f1f8 req-2dd78695-1557-4cd7-b8e7-a863a46353f7 service nova] Creating event network-vif-plugged:1f9b1a68-4136-4ee8-9212-584268a6798e for instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 on hv-cinder-86009 Oct 03 13:37:46.308258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-ed9e0177-5d9e-4c2f-b206-f2e42d92f1f8 req-2dd78695-1557-4cd7-b8e7-a863a46353f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319370 Oct 03 13:37:46.310313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 338/676] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:46.571007 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:46.571719 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:46.588875 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:46.589383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:46.589882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:46.590611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:46.591073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:46.591501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:46.844719 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:46.845848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:46.860209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:46.860975 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:46.862969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:46.865006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:46.865353 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:46.866579 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:46.867250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:46.879486 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e16fb181-a242-47b2-8368-a93dd9248df4 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1367 microversion: 2.1 time: 0.319355 Oct 03 13:37:46.880452 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 339/677] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:46 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:46.890356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] HTTP exception thrown: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Request method failure captured: Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 HTTP/1.1 Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuR4MUA9tWNNFzHaURDO-XM9hOhK-itIeRMN4nfSM5qG_oJln7tHJMrtczcNyi3kkL4yCPbH1_enn4kKDotOMJvDEWTCgjHtTCddABe7qdzwFkg0w78aJLPjMZUAGjPLICJ7qX5ekhLNJ3xxrPZVLy6x53qWNAD97dPoJ18KnCdMyCE Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:37:46.893351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 4471a60040ca42649f2718fd46659e31 Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:37:46.894887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '2ca377db-f0f6-4888-a94e-cfde65e470e9'} Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:37:46.896861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:37:46.898529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:37:46.901321 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Returning 404 to user: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:37:46.902459 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-13ae220c-fa6d-4759-956a-8b4f8c3ef8c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 404 len: 111 microversion: 2.1 time: 0.062268 Oct 03 13:37:46.903616 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 339/678] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:46 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:37:46.913981 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-06c7a8c9-745c-49d3-9eb9-52a9a951a441 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '.version_select at 0x7f7c2195e820>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:46.961095 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-06c7a8c9-745c-49d3-9eb9-52a9a951a441 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051871299" status: 202 len: 0 microversion: 2.1 time: 0.051890 Oct 03 13:37:46.965776 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 340/679] 10.222.0.58 () {58 vars in 1221 bytes} [Mon Oct 3 13:37:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051871299 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:37:47.907046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:47.909065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:47.929628 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:47.930469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:47.931094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:47.931990 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:47.932661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:47.933239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:48.203137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:48.220115 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3797824f-5f81-4d0e-a378-163970aa8f87 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1367 microversion: 2.1 time: 0.311682 Oct 03 13:37:48.221430 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 340/680] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:47 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:48.436295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c0890c93-dea8-4b9d-81aa-0cdaf21bd9bd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'create', calling method: .version_select at 0x7f7c218c9a60>, body: {"keypair": {"name": "tempest-keypair-744805734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsqF8+oCiuUkCyOmCX2wJmx49MPsM0HOQN5s8kI9yVHsJBVi3aWgylO6hb/VnSOpdcDla2isHA9y7wiu8WlH2xZW4kbjts2pGCxKAUqm1zVDvbVzmkIl8Ulb3Vp2gJIIw=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:48.459475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-c0890c93-dea8-4b9d-81aa-0cdaf21bd9bd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Getting quotas for project 1432ad4a21624574b8caeaf10f2f8339. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:37:48.464826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-c0890c93-dea8-4b9d-81aa-0cdaf21bd9bd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Getting quotas for user 4471a60040ca42649f2718fd46659e31 and project 1432ad4a21624574b8caeaf10f2f8339. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:37:48.507892 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c0890c93-dea8-4b9d-81aa-0cdaf21bd9bd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076420 Oct 03 13:37:48.508913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 341/681] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:37:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:37:49.248260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:49.248891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:49.261537 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:49.262050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:49.262494 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:49.263272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:49.263678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:49.264128 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:49.564798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:49.578158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0198af8e-a631-47b5-adfb-332ad3622be3 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1557 microversion: 2.1 time: 0.334468 Oct 03 13:37:49.603008 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:49.603535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 341/682] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:49 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1557 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:49.604633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:49.612253 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:49.613070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:49.613633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:49.614677 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:49.615356 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:49.616009 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:49.800293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3c4d8907-734a-4b3a-b7b6-4ea1e3becb3e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201817 Oct 03 13:37:49.801084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 342/683] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 3 13:37:49 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:37:49.837606 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8bf14811-4e18-499c-9bca-6d22b43eb70d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'create', calling method: .version_select at 0x7f7c21aa1e50>, body: {"keypair": {"name": "tempest-keypair-189810902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIZlDjf6Aprbr3yixToGGJGvT9esDeUUDLDBSt1UWQoTnTL5CJJwINzkKnue8dy5ye9F4UD2kysKFRXDc0eWeoUxcB+Guhzya2zzxpEkJIWHKLT1nWKOxUQiE8ZrIpOgA=="}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:49.880613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-8bf14811-4e18-499c-9bca-6d22b43eb70d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Getting quotas for project e019f687769f408d9c3faab0c8693a9d. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:37:49.886859 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-8bf14811-4e18-499c-9bca-6d22b43eb70d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Getting quotas for user 21fde7fa2a16426890bdcba2241778ed and project e019f687769f408d9c3faab0c8693a9d. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:37:49.934348 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8bf14811-4e18-499c-9bca-6d22b43eb70d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.183194 Oct 03 13:37:49.935424 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 342/684] 10.222.0.58 () {62 vars in 1200 bytes} [Mon Oct 3 13:37:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 03 13:37:50.704629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1882063398", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ae25b55-bed6-49d7-9a22-c9e416e149dd"}], "security_groups": [{"name": "tempest-securitygroup--798851978"}], "key_name": "tempest-keypair-744805734", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:51.136089 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] validate_networks() for [('4ae25b55-bed6-49d7-9a22-c9e416e149dd', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:37:51.894690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-90ef70b5-cf03-494b-99bb-60b2e0674cd3 req-c9dd80f1-16a9-4daf-a3d2-fc9e86cef70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a4790f-1fa2-4b82-a496-f6d5083042e3", "tag": "1f9b1a68-4136-4ee8-9212-584268a6798e"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:51.919724 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:37:51.921549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:37:51.925528 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:37:51.926438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:37:51.928211 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:37:51.940541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-90ef70b5-cf03-494b-99bb-60b2e0674cd3 req-c9dd80f1-16a9-4daf-a3d2-fc9e86cef70d service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:51.941514 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-90ef70b5-cf03-494b-99bb-60b2e0674cd3 req-c9dd80f1-16a9-4daf-a3d2-fc9e86cef70d service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:51.943222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-90ef70b5-cf03-494b-99bb-60b2e0674cd3 req-c9dd80f1-16a9-4daf-a3d2-fc9e86cef70d service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:51.957245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:51.958583 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:51.963156 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:51.967048 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:51.969309 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:51.970061 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:51.978497 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-90ef70b5-cf03-494b-99bb-60b2e0674cd3 req-c9dd80f1-16a9-4daf-a3d2-fc9e86cef70d service nova] Creating event network-changed:1f9b1a68-4136-4ee8-9212-584268a6798e for instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 on hv-cinder-86009 Oct 03 13:37:52.002133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-90ef70b5-cf03-494b-99bb-60b2e0674cd3 req-c9dd80f1-16a9-4daf-a3d2-fc9e86cef70d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109130 Oct 03 13:37:52.005271 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 343/685] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:52.053012 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Getting quotas for project 1432ad4a21624574b8caeaf10f2f8339. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:37:52.061325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Getting quotas for user 4471a60040ca42649f2718fd46659e31 and project 1432ad4a21624574b8caeaf10f2f8339. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:37:52.104178 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:37:52.112289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:37:52.192360 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-981b0e31-7bd2-447a-88ed-e894d6ef90ff tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.491886 Oct 03 13:37:52.194469 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 343/686] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:37:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:37:52.207379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6113e8e1-1865-48c9-ba9c-5455cd6ebac1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:52.208650 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6113e8e1-1865-48c9-ba9c-5455cd6ebac1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:52.307991 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6113e8e1-1865-48c9-ba9c-5455cd6ebac1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:52.316854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6113e8e1-1865-48c9-ba9c-5455cd6ebac1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1237 microversion: 2.1 time: 0.114831 Oct 03 13:37:52.320305 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 344/687] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:52 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:52.858859 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-232853032", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83166103-7560-4ace-bfbe-05a1216e31b8"}], "security_groups": [{"name": "tempest-securitygroup--1986246387"}], "key_name": "tempest-keypair-189810902", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:53.126675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] validate_networks() for [('83166103-7560-4ace-bfbe-05a1216e31b8', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:37:53.367023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:53.368440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:53.388907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:53.390011 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:53.390539 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:53.391394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:53.392002 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:53.394766 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:53.498091 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:53.508276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-58f0292e-1202-4d26-b397-4595d9e6dacd tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1289 microversion: 2.1 time: 0.147822 Oct 03 13:37:53.509075 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 345/688] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:53 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1289 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:37:53.722228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:37:53.722578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:37:53.723300 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:37:53.723683 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:37:53.724099 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:37:53.734234 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:53.734989 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:53.735782 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:53.737064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:53.737555 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:53.737985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:53.759475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Getting quotas for project e019f687769f408d9c3faab0c8693a9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:37:53.764794 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Getting quotas for user 21fde7fa2a16426890bdcba2241778ed and project e019f687769f408d9c3faab0c8693a9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:37:53.782675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:37:53.806986 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:37:53.890132 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f871efa6-c1e8-4a31-b5b2-32df8f62d3aa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.034689 Oct 03 13:37:53.898955 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 344/689] 10.222.0.58 () {62 vars in 1188 bytes} [Mon Oct 3 13:37:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 03 13:37:53.904494 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f4066300-5f18-460e-aea2-40b8e1c8caf1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:53.905126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f4066300-5f18-460e-aea2-40b8e1c8caf1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:54.012210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f4066300-5f18-460e-aea2-40b8e1c8caf1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:54.024297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f4066300-5f18-460e-aea2-40b8e1c8caf1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:54.026553 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f4066300-5f18-460e-aea2-40b8e1c8caf1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:54.028096 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f4066300-5f18-460e-aea2-40b8e1c8caf1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1280 microversion: 2.20 time: 0.128536 Oct 03 13:37:54.029918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 346/690] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:37:53 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:37:54.533115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:54.533889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:54.541164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:54.541688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:54.542127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:54.542826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:54.543461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:54.543898 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:54.636397 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:54.645563 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-36a40e5f-cfa0-428c-bf9c-f94f310bb5a7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1295 microversion: 2.1 time: 0.116825 Oct 03 13:37:54.646237 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 345/691] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:54 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1295 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:55.055003 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:55.055631 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:55.063658 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:55.064810 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:55.065233 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:55.066048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:55.066515 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:55.066948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:55.130247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:55.138383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:55.139835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:55.140940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-17268977-b48a-43a6-9551-6dc43494f9dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1332 microversion: 2.20 time: 0.089977 Oct 03 13:37:55.141514 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 347/692] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:37:55 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:37:55.669164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:55.669818 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:55.677392 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:55.677999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:55.678443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:55.679152 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:55.679611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:55.680245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:56.021171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:56.030912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4419bbdf-b737-45ac-b55f-8a4d67977375 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.365641 Oct 03 13:37:56.045647 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 346/693] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:55 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:56.167289 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:56.168050 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:56.176012 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:56.176598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:56.177053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:56.177875 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:56.178279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:56.178715 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:56.247837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:56.257364 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:56.258880 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:56.260018 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e5ac5c6f-4108-4705-843c-366f8c13d87f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1338 microversion: 2.20 time: 0.096699 Oct 03 13:37:56.260591 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 348/694] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:37:56 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:37:56.840250 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-21f60d48-9393-44f1-b031-1b58f7c1e826 req-d0ae1634-6766-49d1-bc30-b4059a7cfde2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0", "tag": "4fedd529-0907-4e1f-afe2-2a21d1185f1d"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:56.862844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-21f60d48-9393-44f1-b031-1b58f7c1e826 req-d0ae1634-6766-49d1-bc30-b4059a7cfde2 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:56.863667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-21f60d48-9393-44f1-b031-1b58f7c1e826 req-d0ae1634-6766-49d1-bc30-b4059a7cfde2 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:56.864672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-21f60d48-9393-44f1-b031-1b58f7c1e826 req-d0ae1634-6766-49d1-bc30-b4059a7cfde2 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:56.877854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-21f60d48-9393-44f1-b031-1b58f7c1e826 req-d0ae1634-6766-49d1-bc30-b4059a7cfde2 service nova] Creating event network-changed:4fedd529-0907-4e1f-afe2-2a21d1185f1d for instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 on hv-cinder-86009 Oct 03 13:37:56.883585 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-21f60d48-9393-44f1-b031-1b58f7c1e826 req-d0ae1634-6766-49d1-bc30-b4059a7cfde2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049646 Oct 03 13:37:56.884566 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 347/695] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:37:57.056516 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:57.057230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:57.064016 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:57.064879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:57.065521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:57.066321 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:57.066851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:57.067352 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:57.226807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:57.236407 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a6ad0c92-a6a5-4e8d-8cdd-e72b9c1d757b tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.183177 Oct 03 13:37:57.237836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 349/696] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:57 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:57.286523 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:57.287233 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:57.293445 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:57.293973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:57.294423 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:57.295114 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:57.295578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:57.296001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:57.556369 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:57.565568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:57.567138 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:57.568352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-33f9bf0e-0293-48c7-b54d-eb0b17dd827b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.286911 Oct 03 13:37:57.568925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 348/697] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:37:57 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:37:58.260683 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:58.261335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:58.268544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:58.269037 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:58.269886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:58.270841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:58.271312 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:58.271746 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:58.410356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:58.418784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8ba42b1b-e822-470a-b82a-d50497ca286c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.161973 Oct 03 13:37:58.419554 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 350/698] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:58 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:58.594499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:58.595054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:58.601909 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:58.602404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:58.602847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:58.603545 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:58.604002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:58.604432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:58.908692 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-9e9e6010-f0e0-4417-b60d-2ef94bb5d44e req-98b4d53d-a253-47cf-8173-6ec9500744c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703", "tag": "a788fb3b-a7c9-4293-adc4-4714a34e7902"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:37:58.918134 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-9e9e6010-f0e0-4417-b60d-2ef94bb5d44e req-98b4d53d-a253-47cf-8173-6ec9500744c0 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:58.918607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-9e9e6010-f0e0-4417-b60d-2ef94bb5d44e req-98b4d53d-a253-47cf-8173-6ec9500744c0 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:58.919030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-9e9e6010-f0e0-4417-b60d-2ef94bb5d44e req-98b4d53d-a253-47cf-8173-6ec9500744c0 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:58.930680 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-9e9e6010-f0e0-4417-b60d-2ef94bb5d44e req-98b4d53d-a253-47cf-8173-6ec9500744c0 service nova] Creating event network-changed:a788fb3b-a7c9-4293-adc4-4714a34e7902 for instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 on hv-cinder-86009 Oct 03 13:37:58.935540 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-9e9e6010-f0e0-4417-b60d-2ef94bb5d44e req-98b4d53d-a253-47cf-8173-6ec9500744c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031108 Oct 03 13:37:58.936376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 351/699] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:37:58.937976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:58.948082 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:58.949573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:58.950733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fe2dc416-d0da-4ffb-a055-7f572b10e665 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.360313 Oct 03 13:37:58.951316 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 349/700] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:37:58 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:37:59.443293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:59.444230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:59.450993 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:59.451489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:59.451927 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:59.452781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:59.453423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:59.453871 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:59.588424 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:37:59.597023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2ef8fba2-77b6-4239-b9fa-ec8290128c6a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.158854 Oct 03 13:37:59.597631 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 352/701] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:37:59 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:37:59.976378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:37:59.977027 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:37:59.983550 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:59.984037 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:59.984475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:37:59.985163 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:37:59.985720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:37:59.986190 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:00.123835 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:00.133475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:00.134944 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:00.136066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f66a614c-93e9-47cc-97ca-8604cff89687 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.163604 Oct 03 13:38:00.136637 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 350/702] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:37:59 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:00.620111 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:00.620730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:00.628325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:00.628985 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:00.629597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:00.630487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:00.630962 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:00.631438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:00.775305 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:00.784334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c6e398f9-7333-4e1b-af15-e653d3182115 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.168008 Oct 03 13:38:00.784936 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 353/703] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:00 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:38:01.167410 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:01.168519 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:01.180712 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:01.181618 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:01.182357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:01.183563 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:01.184363 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:01.185086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:01.336414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:01.347932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:01.349394 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:01.350562 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a6bf3b19-ee27-4e40-8eac-235a8ea06183 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.190888 Oct 03 13:38:01.351134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 351/704] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:38:01 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:01.808223 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:01.808887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:01.816838 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:01.817359 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:01.825026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:01.825026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:01.825026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:01.825026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:01.961535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:01.969505 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0ec7ab63-7384-47dd-9660-d1f1264f32d7 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.164982 Oct 03 13:38:01.970688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 354/705] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:01 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:38:02.375926 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:02.377282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:02.383975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:02.384457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:02.384893 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:02.385621 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:02.386073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:02.386496 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:02.516365 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:02.525730 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:02.527182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:02.528639 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-726b7a34-fe95-4617-aa3a-f07498ff23ce tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.156587 Oct 03 13:38:02.528857 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 352/706] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:38:02 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:02.994136 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:02.994838 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:03.002282 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:03.003015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:03.003466 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:03.004174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:03.004642 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:03.005069 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:03.144055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:03.151983 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7436d597-f805-4402-af1c-3a00938bcfc0 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.161654 Oct 03 13:38:03.152576 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 355/707] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:02 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:38:03.557191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:03.557830 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:03.562096 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:03.568243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:03.568752 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:03.569244 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:03.570016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:03.570479 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:03.570899 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:03.728574 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:03.739576 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:03.741100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:03.742505 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fa485e8c-5a55-4ffb-b5f3-93b0329a90a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.190623 Oct 03 13:38:03.743066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 353/708] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:38:03 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:03.938627 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-19f00b1e-d9e0-4b1a-a903-1adf539726ec req-e37329f7-b0e7-4568-a811-0b0608d31326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0", "name": "network-vif-plugged", "status": "completed", "tag": "4fedd529-0907-4e1f-afe2-2a21d1185f1d"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:38:03.949572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-19f00b1e-d9e0-4b1a-a903-1adf539726ec req-e37329f7-b0e7-4568-a811-0b0608d31326 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:03.950097 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-19f00b1e-d9e0-4b1a-a903-1adf539726ec req-e37329f7-b0e7-4568-a811-0b0608d31326 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:03.950490 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-19f00b1e-d9e0-4b1a-a903-1adf539726ec req-e37329f7-b0e7-4568-a811-0b0608d31326 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:03.966343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-19f00b1e-d9e0-4b1a-a903-1adf539726ec req-e37329f7-b0e7-4568-a811-0b0608d31326 service nova] Creating event network-vif-plugged:4fedd529-0907-4e1f-afe2-2a21d1185f1d for instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 on hv-cinder-86009 Oct 03 13:38:03.972819 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-19f00b1e-d9e0-4b1a-a903-1adf539726ec req-e37329f7-b0e7-4568-a811-0b0608d31326 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038721 Oct 03 13:38:03.973884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 356/709] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:38:04.176502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:04.177045 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:04.180243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:04.181514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=16 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:04.190685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:04.190901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:04.191281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:04.192442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:04.192442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:04.192834 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:04.351816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:04.359923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3b52f9e2-ec4f-4b5d-b927-124b4bc3352a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.188511 Oct 03 13:38:04.360486 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 354/710] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:04 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:38:04.765768 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=8 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:04.770014 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:04.770758 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:04.777266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:04.777793 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:04.778239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:04.778949 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:04.779409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:04.779841 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:04.927511 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:04.936013 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:04.937772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:04.939749 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a8d1c7ce-a222-42ae-8c18-6f61eb6b2e89 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.175494 Oct 03 13:38:04.940344 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 357/711] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:38:04 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:05.384947 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:05.385579 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:05.393087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:05.393779 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:05.394220 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:05.394924 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:05.395374 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:05.395795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:05.533537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:05.541695 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-761b66fb-5899-4c5a-b3f6-5234be1bfeb4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1362 microversion: 2.1 time: 0.160857 Oct 03 13:38:05.542599 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 355/712] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:05 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:38:05.966194 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:05.966809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:05.973693 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:05.974183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:05.974624 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:05.975329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:05.975786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:05.976215 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:05.995365 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-3f62670f-5d34-4ec6-b30f-11c2af0e7b9d req-1d85eafc-db19-4e79-b1c4-c88cb37695f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703", "name": "network-vif-plugged", "status": "completed", "tag": "a788fb3b-a7c9-4293-adc4-4714a34e7902"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:38:06.006325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3f62670f-5d34-4ec6-b30f-11c2af0e7b9d req-1d85eafc-db19-4e79-b1c4-c88cb37695f2 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:06.006942 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3f62670f-5d34-4ec6-b30f-11c2af0e7b9d req-1d85eafc-db19-4e79-b1c4-c88cb37695f2 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:06.007438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3f62670f-5d34-4ec6-b30f-11c2af0e7b9d req-1d85eafc-db19-4e79-b1c4-c88cb37695f2 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:06.020276 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-3f62670f-5d34-4ec6-b30f-11c2af0e7b9d req-1d85eafc-db19-4e79-b1c4-c88cb37695f2 service nova] Creating event network-vif-plugged:a788fb3b-a7c9-4293-adc4-4714a34e7902 for instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 on hv-cinder-86009 Oct 03 13:38:06.026028 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-3f62670f-5d34-4ec6-b30f-11c2af0e7b9d req-1d85eafc-db19-4e79-b1c4-c88cb37695f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034254 Oct 03 13:38:06.026657 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 356/713] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:38:06.121001 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:06.131039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:06.132500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:06.133695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-cfb001ea-1f96-4988-86ec-ada8f5b4bb93 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.171344 Oct 03 13:38:06.134729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 358/714] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:38:05 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:06.566514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:06.567279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:06.573736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:06.574481 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:06.574676 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:06.575368 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:06.575825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:06.576290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:06.580749 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:06.708886 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:06.716769 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5216d806-4af1-4eda-a300-e2e29cadba99 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1548 microversion: 2.1 time: 0.155284 Oct 03 13:38:06.717346 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 357/715] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:06 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:38:06.740614 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:06.741253 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:06.747265 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:06.747746 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:06.748182 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:06.748868 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:06.749321 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:06.749777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:06.838333 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a413a51c-ee05-4086-9d4c-91d635dd78f8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101601 Oct 03 13:38:06.838935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 359/716] 10.222.0.58 () {58 vars in 1275 bytes} [Mon Oct 3 13:38:06 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:38:07.160333 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:07.160985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:07.166999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:07.167490 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:07.167926 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:07.168623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:07.169073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:07.169524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:07.307616 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:07.317318 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:07.318959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:07.320328 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-df56e10f-a40a-4f50-a08d-b95c007b72de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.164732 Oct 03 13:38:07.320941 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 358/717] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:38:07 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:08.143162 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-97609f6f-36d9-4d9c-a5f3-836858bf2ab1 req-b0af2363-785b-4a72-9b63-f4239c2151ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0", "tag": "4fedd529-0907-4e1f-afe2-2a21d1185f1d"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:38:08.153296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-97609f6f-36d9-4d9c-a5f3-836858bf2ab1 req-b0af2363-785b-4a72-9b63-f4239c2151ee service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:08.153811 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-97609f6f-36d9-4d9c-a5f3-836858bf2ab1 req-b0af2363-785b-4a72-9b63-f4239c2151ee service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:08.154253 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-97609f6f-36d9-4d9c-a5f3-836858bf2ab1 req-b0af2363-785b-4a72-9b63-f4239c2151ee service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:08.169118 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-97609f6f-36d9-4d9c-a5f3-836858bf2ab1 req-b0af2363-785b-4a72-9b63-f4239c2151ee service nova] Creating event network-changed:4fedd529-0907-4e1f-afe2-2a21d1185f1d for instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 on hv-cinder-86009 Oct 03 13:38:08.175606 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-97609f6f-36d9-4d9c-a5f3-836858bf2ab1 req-b0af2363-785b-4a72-9b63-f4239c2151ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097062 Oct 03 13:38:08.177217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 360/718] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:38:08.348308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:08.349338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:08.357999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:08.358641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:08.359087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:08.359836 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:08.360426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:08.360906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:08.510442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:08.519824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:08.521330 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:08.522527 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3239cda8-3bf1-4581-82da-42fae94bc003 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1406 microversion: 2.20 time: 0.180205 Oct 03 13:38:08.523110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 359/719] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:38:08 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:09.549589 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:09.550335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:09.557498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:09.558016 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:09.558467 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:09.559195 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:09.560301 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:09.560748 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:09.581229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=100 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:09.702776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:09.712416 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:09.713982 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:09.715175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c09b0d61-fecc-41a6-a524-ffccc7a56a6a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1598 microversion: 2.20 time: 0.170711 Oct 03 13:38:09.715751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 361/720] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:38:09 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:38:09.741636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:09.742304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:09.748642 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:09.749131 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:09.749619 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:09.750586 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:09.751129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:09.751564 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:09.902625 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-df898cac-230f-4382-8da5-e1ab3940d476 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.164943 Oct 03 13:38:09.903228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 360/721] 10.222.0.58 () {60 vars in 1316 bytes} [Mon Oct 3 13:38:09 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:38:10.949905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-6b1a0c51-e62e-4d76-b9f1-d563a3b16afe req-d764c28d-b76c-4865-9289-a5fb847989e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703", "tag": "a788fb3b-a7c9-4293-adc4-4714a34e7902"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:38:10.960906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-6b1a0c51-e62e-4d76-b9f1-d563a3b16afe req-d764c28d-b76c-4865-9289-a5fb847989e0 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:10.961501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-6b1a0c51-e62e-4d76-b9f1-d563a3b16afe req-d764c28d-b76c-4865-9289-a5fb847989e0 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:10.961943 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-6b1a0c51-e62e-4d76-b9f1-d563a3b16afe req-d764c28d-b76c-4865-9289-a5fb847989e0 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:10.974133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-6b1a0c51-e62e-4d76-b9f1-d563a3b16afe req-d764c28d-b76c-4865-9289-a5fb847989e0 service nova] Creating event network-changed:a788fb3b-a7c9-4293-adc4-4714a34e7902 for instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 on hv-cinder-86009 Oct 03 13:38:10.979855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-6b1a0c51-e62e-4d76-b9f1-d563a3b16afe req-d764c28d-b76c-4865-9289-a5fb847989e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033686 Oct 03 13:38:10.981368 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 362/722] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:38:36.458077 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=14 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:36.458836 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=20 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:36.463232 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:36.463730 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:36.471153 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:36.471640 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:36.472077 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:36.472781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:36.473239 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:36.473795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:36.499386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dd5ff086-d326-41bd-a228-75444d758f98 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/ips" status: 200 len: 150 microversion: 2.1 time: 0.042905 Oct 03 13:38:36.500247 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 361/723] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:38:36 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:38:37.935269 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18b70bfb-5070-48c1-be67-726da158155d"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:38:37.939285 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:37.942943 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:37.944630 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:38:37.955823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:37.956551 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:37.957218 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:37.958114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:37.959610 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:37.960228 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:38.267216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-06025b22-f586-49b2-b639-edb1de844193 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "POST /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337051 Oct 03 13:38:38.268527 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 363/724] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:38:37 2022] POST /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:38:45.962611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:45.963225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:45.969802 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:45.970287 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:45.970722 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:45.971418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:45.971871 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:45.972292 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:46.060888 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lazy-loading 'services' on Instance uuid d7a4790f-1fa2-4b82-a496-f6d5083042e3 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:38:46.139720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-03752dd8-7f91-492d-a5cb-2b3430ffa87a tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-volume_attachments/18b70bfb-5070-48c1-be67-726da158155d" status: 202 len: 0 microversion: 2.1 time: 0.181033 Oct 03 13:38:46.140495 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 362/725] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:38:45 2022] DELETE /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-volume_attachments/18b70bfb-5070-48c1-be67-726da158155d => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:38:46.149565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:46.151879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:46.159316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:46.159813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:46.160257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:46.161130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:46.161844 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:46.162942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:46.198238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d77e0843-3601-4f49-ac65-a91740bb1ec2 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053155 Oct 03 13:38:46.198833 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 364/726] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:38:46 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:38:47.212305 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:47.214683 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:47.221000 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:47.221514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:47.221959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:47.222647 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:47.223100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:47.223524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:47.252976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-373d69c7-5103-41ba-98d9-7427f1ff5616 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045621 Oct 03 13:38:47.253556 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 363/727] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:38:47 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:38:47.316845 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:47.317352 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:47.324144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:47.324636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:47.325078 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:47.325811 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:47.326270 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:47.326701 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:47.353055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:38:47.431529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ce187fd4-62ed-453e-9c7b-496c9e1ed5ab tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 204 len: 0 microversion: 2.1 time: 0.118749 Oct 03 13:38:47.432225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 365/728] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:38:47 2022] DELETE /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:38:47.442596 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:47.443230 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:47.449314 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:47.449834 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:47.450259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:47.450938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:47.451385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:47.451802 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:47.580312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:47.588216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ebd1516e-ec1a-400e-b5d4-9435cd86ba8e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1682 microversion: 2.1 time: 0.151466 Oct 03 13:38:47.588798 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 364/729] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:47 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:38:48.614195 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:48.614918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:48.621906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:48.622401 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:48.622851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:48.623612 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:48.624006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:48.624517 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:48.768604 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:48.776729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-bf41b40a-d7c4-4f9d-b10d-7a0b3063157e tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1682 microversion: 2.1 time: 0.167896 Oct 03 13:38:48.777299 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 366/730] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:48 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:38:49.801588 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:49.802187 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:49.808931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:49.809419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:49.809895 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:49.810595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:49.811049 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:49.811470 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:50.030604 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:50.038512 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-92121a64-64fc-4dcb-9234-e2371e8b3734 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1682 microversion: 2.1 time: 0.241940 Oct 03 13:38:50.039082 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 365/731] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:49 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:38:50.630609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-d59e3947-0b28-4db5-9ded-dec8025369af req-55fd8ac8-06b5-4eef-830d-74f244cfd30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a4790f-1fa2-4b82-a496-f6d5083042e3", "name": "network-vif-deleted", "tag": "1f9b1a68-4136-4ee8-9212-584268a6798e"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:38:50.643044 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-d59e3947-0b28-4db5-9ded-dec8025369af req-55fd8ac8-06b5-4eef-830d-74f244cfd30e service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:50.643520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-d59e3947-0b28-4db5-9ded-dec8025369af req-55fd8ac8-06b5-4eef-830d-74f244cfd30e service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:50.644541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-d59e3947-0b28-4db5-9ded-dec8025369af req-55fd8ac8-06b5-4eef-830d-74f244cfd30e service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:50.656727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-d59e3947-0b28-4db5-9ded-dec8025369af req-55fd8ac8-06b5-4eef-830d-74f244cfd30e service nova] Creating event network-vif-deleted:1f9b1a68-4136-4ee8-9212-584268a6798e for instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 on hv-cinder-86009 Oct 03 13:38:50.662654 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-d59e3947-0b28-4db5-9ded-dec8025369af req-55fd8ac8-06b5-4eef-830d-74f244cfd30e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036670 Oct 03 13:38:50.663806 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 367/732] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:38:51.062604 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:51.063227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:51.071072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:51.071467 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:51.071905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:51.072609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:51.073062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:51.073513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:51.106418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:51.106904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:51.107352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:51.107798 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lazy-loading 'fault' on Instance uuid d7a4790f-1fa2-4b82-a496-f6d5083042e3 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:38:51.151511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98de1ccbabc64162a29cbce2cfe11600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e6dd58ff43419fa5b945bd08ef2931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:38:51.159675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cf5b5386-290d-4579-8f42-4c1a7943a6aa tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 200 len: 1331 microversion: 2.1 time: 0.100879 Oct 03 13:38:51.160386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 366/733] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:51 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:38:52.184169 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:52.184871 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:52.191956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:52.192448 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:52.192891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:52.193614 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:52.194083 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:52.194528 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:52.208123 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 HTTP/1.1 Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:38:52.209792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:52.211387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': 'd7a4790f-1fa2-4b82-a496-f6d5083042e3'} Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:52.212376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:52.213908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:52.215266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:52.215266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3dab4ff0-4f19-41a8-bb64-878e90c8be1c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 404 len: 111 microversion: 2.1 time: 0.031255 Oct 03 13:38:52.215266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 368/734] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:52 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:52.220216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1e17751c-82e6-4fad-b0be-a80f827ba864 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '.version_select at 0x7f7c2193ac10>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:52.241080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1e17751c-82e6-4fad-b0be-a80f827ba864 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887261099" status: 202 len: 0 microversion: 2.1 time: 0.024584 Oct 03 13:38:52.242223 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 367/735] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 3 13:38:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887261099 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:38:53.988995 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:53.989591 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:53.995930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:53.996406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:53.996860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:53.997582 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:53.998039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:53.998453 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:54.012806 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 HTTP/1.1 Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:38:54.014374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.015912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': 'd7a4790f-1fa2-4b82-a496-f6d5083042e3'} Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:54.016813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.019028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.020409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:54.020409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9da2e4b9-b238-4518-8d7e-20157f90e12c tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 404 len: 111 microversion: 2.1 time: 0.030830 Oct 03 13:38:54.020409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 369/736] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:38:53 2022] DELETE /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:54.025804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:54.026524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: d7a4790f-1fa2-4b82-a496-f6d5083042e3] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:54.034426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:54.034913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:54.035352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:54.036044 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:54.036510 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:54.036938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:54.050799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 HTTP/1.1 Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:38:54.052444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.054887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'd7a4790f-1fa2-4b82-a496-f6d5083042e3'} Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:54.056500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. Oct 03 13:38:54.059206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:54.061185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance d7a4790f-1fa2-4b82-a496-f6d5083042e3 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:54.061185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-639b0b6c-01a0-4733-ae38-7a8ea1e53879 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3" status: 404 len: 111 microversion: 2.1 time: 0.032844 Oct 03 13:38:54.061185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 368/737] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:54 2022] GET /compute/v2.1/servers/d7a4790f-1fa2-4b82-a496-f6d5083042e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:54.644355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:54.644768 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:54.650906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:54.651428 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:54.651865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:54.652573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:54.653049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:54.653483 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:54.678734 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-751b523d-7344-409f-bc0c-011cd92ccc97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/ips" status: 200 len: 144 microversion: 2.1 time: 0.039055 Oct 03 13:38:54.679327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 370/738] 10.222.0.58 () {58 vars in 1248 bytes} [Mon Oct 3 13:38:54 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:38:55.207038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:55.207578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:55.213897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:55.214386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:55.214812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:55.215477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:55.215919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:55.216341 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:55.229514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: DELETE /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 HTTP/1.1 Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:38:55.231042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.232560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '0f9b4c95-6c82-4aca-97eb-44eb954c5ca0'} Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:55.233477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.234995 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.236531 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:55.236531 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e04bf0de-6ac0-421b-af43-1e03e7f7f623 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 404 len: 111 microversion: 2.1 time: 0.029905 Oct 03 13:38:55.236531 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 369/739] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:38:55 2022] DELETE /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:55.241055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:55.241730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:55.248243 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:55.248733 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:55.249174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:55.250179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:55.250635 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:55.251065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:55.266483 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 HTTP/1.1 Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:38:55.268700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.271132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '0f9b4c95-6c82-4aca-97eb-44eb954c5ca0'} Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:55.272570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. Oct 03 13:38:55.275043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.277056 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:55.277056 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1737b2db-1580-4deb-ae35-499722c820da tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0" status: 404 len: 111 microversion: 2.1 time: 0.032956 Oct 03 13:38:55.277056 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 371/740] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:55 2022] GET /compute/v2.1/servers/0f9b4c95-6c82-4aca-97eb-44eb954c5ca0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:55.279170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:55.279703 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:55.285805 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:55.286285 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:55.286709 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:55.287425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:55.287919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:55.288408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:55.301755 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: DELETE /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 HTTP/1.1 Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:38:55.303296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.305855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '1530d3cd-a03d-4ccc-bf56-064b83e978c8'} Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:55.306901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.309026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.311397 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:55.311397 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-be8df05a-0801-4826-b58a-c5c7acbf330d tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 404 len: 111 microversion: 2.1 time: 0.029801 Oct 03 13:38:55.311397 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 370/741] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:38:55 2022] DELETE /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:55.313082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:55.313724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 1530d3cd-a03d-4ccc-bf56-064b83e978c8] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:55.320255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:55.320727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:55.321156 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:55.321857 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:55.322306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:55.322726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:55.336655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 HTTP/1.1 Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:38:55.338186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.340240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '1530d3cd-a03d-4ccc-bf56-064b83e978c8'} Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:55.341373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. Oct 03 13:38:55.343317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:55.345770 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 1530d3cd-a03d-4ccc-bf56-064b83e978c8 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:55.345770 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-296855eb-9540-47f3-abd6-0b555cb547fd tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8" status: 404 len: 111 microversion: 2.1 time: 0.030221 Oct 03 13:38:55.345770 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 372/742] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:55 2022] GET /compute/v2.1/servers/1530d3cd-a03d-4ccc-bf56-064b83e978c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:56.025298 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "062c1775-b7e0-4313-ad0f-bed31a3dac7a"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:38:56.027806 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:56.034017 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:56.034493 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:56.034921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:56.035599 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:56.036046 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:56.036469 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:56.286247 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e57f6f5b-ec15-4626-894d-605607607044 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264672 Oct 03 13:38:56.286984 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 371/743] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:38:56 2022] POST /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:38:56.486735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:56.487307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:56.495218 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:56.495712 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:56.496204 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:56.497007 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:56.497568 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:56.498145 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:56.514448 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 HTTP/1.1 Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:38:56.515933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.517594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '7a9ff191-d009-41e4-9966-44fe462252b5'} Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:56.518455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.519760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.520997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:56.520997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-413c815d-d664-4cd6-bcab-f3c907ffffbe tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 404 len: 111 microversion: 2.1 time: 0.035132 Oct 03 13:38:56.520997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 373/744] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:38:56 2022] DELETE /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:38:56.527403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:56.528112 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] [instance: 7a9ff191-d009-41e4-9966-44fe462252b5] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:56.535879 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:56.536367 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:56.536807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:56.537552 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:56.538003 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:56.538430 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:56.554489 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] HTTP exception thrown: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Request method failure captured: Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 HTTP/1.1 Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuQHSLf8S6oagpoOWAR04-3HwMFOGeQbCRrCxIRKygE0Kw3fCF4E94FQI3uZT6o_MVYIEW3DTPpc39n3GV4UClYBf9Aciu9Y5IyBtaGlVuM9Mcz0x3NQvOcN0kMrGR-_CPQi9oq-MIBJdBkpC-FGFnmkCqO0wEVmXwNh7heL0qyzvcA Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:38:56.556167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d8e6dd58ff43419fa5b945bd08ef2931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: d8e6dd58ff43419fa5b945bd08ef2931 Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1287681701 Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 98de1ccbabc64162a29cbce2cfe11600 Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeNegativeTest-1287681701-project Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.557783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '7a9ff191-d009-41e4-9966-44fe462252b5'} Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:38:56.558655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. Oct 03 13:38:56.560053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:38:56.561139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] Returning 404 to user: Instance 7a9ff191-d009-41e4-9966-44fe462252b5 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:38:56.561139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4fd213da-c85d-4fb3-b5ab-4721dd276ad7 tempest-AttachVolumeNegativeTest-1287681701 tempest-AttachVolumeNegativeTest-1287681701-project] 10.222.0.58 "GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5" status: 404 len: 111 microversion: 2.1 time: 0.034932 Oct 03 13:38:56.561139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 372/745] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:38:56 2022] GET /compute/v2.1/servers/7a9ff191-d009-41e4-9966-44fe462252b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:38:57.958570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:38:57.959185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:38:57.965620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:57.966103 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:57.966536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:57.967237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:38:57.967686 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:38:57.968105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:38:57.994637 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f0dc402f-fa47-4072-9273-ccea473268eb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/ips" status: 200 len: 151 microversion: 2.20 time: 0.040104 Oct 03 13:38:57.995295 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 374/746] 10.222.0.58 () {60 vars in 1289 bytes} [Mon Oct 3 13:38:57 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:39:00.799865 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:39:00.800446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:00.807077 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:00.807581 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:00.808022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:00.808703 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:00.809167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:00.809611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:00.834499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lazy-loading 'flavor' on Instance uuid 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:39:01.027346 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-48e19814-f8f1-4efa-bb38-cb6e45c67249 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/action" status: 202 len: 0 microversion: 2.20 time: 0.231780 Oct 03 13:39:01.028315 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 373/747] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Oct 3 13:39:00 2022] POST /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:39:01.038005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:01.038668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:01.046087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:01.046459 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:01.046900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:01.047842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:01.048785 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:01.049243 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:01.190809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:01.199676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:01.201225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:01.202493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f904069d-4a93-4750-b0af-d8b4c7e4b12f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.168741 Oct 03 13:39:01.208116 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 375/748] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:01 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:02.243396 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:02.244119 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:02.254540 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:02.255217 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:02.255658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:02.256402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:02.256991 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:02.257264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:02.401376 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:02.411061 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:02.412629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:02.414066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bfac5e22-e443-4b94-9570-92663d08889c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.177549 Oct 03 13:39:02.414753 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 374/749] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:02 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:03.440393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:03.441109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:03.447691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:03.448164 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:03.448609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:03.449306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:03.449809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:03.450250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:03.599605 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:03.619108 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:03.620602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:03.625197 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-35d3612a-a9e1-4deb-a41c-24b2821f8108 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.185636 Oct 03 13:39:03.629618 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 376/750] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:03 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:03.923375 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:03.925901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:03.932549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:03.933043 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:03.933499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:03.934223 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:03.934662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:03.935081 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:03.966984 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a703b201-4ef7-49ad-b34a-a53c5971c2e5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047558 Oct 03 13:39:03.967566 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 375/751] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:39:03 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:39:03.983427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:03.983948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:03.990661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:03.991270 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:03.991676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:03.992395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:03.993052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:03.993551 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:04.026869 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-32980273-c825-4423-9690-0ab987ae140c tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/062c1775-b7e0-4313-ad0f-bed31a3dac7a" status: 200 len: 194 microversion: 2.1 time: 0.049672 Oct 03 13:39:04.027661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 377/752] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Oct 3 13:39:03 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/062c1775-b7e0-4313-ad0f-bed31a3dac7a => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:39:04.652621 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:04.653227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:04.660294 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:04.660789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:04.661230 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:04.661983 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:04.662472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:04.662901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:04.802519 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:04.810803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:04.812304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:04.813501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7c35ac47-30bf-44e4-98b2-fbc1f3337efa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.165190 Oct 03 13:39:04.814253 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 376/753] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:04 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:05.409688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59fbe6ec-c362-4ad4-8071-bb3562366f53"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:39:05.412017 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:05.418368 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:05.418848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:05.419280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:05.419966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:05.420411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:05.420833 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:05.840507 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:05.841112 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:05.847695 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:05.848183 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:05.848618 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:05.849338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:05.849817 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:05.850243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:05.854344 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:05.979081 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:05.987606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:05.989071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:05.990273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5955fdf0-05ad-40b2-9d10-fe6ebe2248ed tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.153706 Oct 03 13:39:05.990831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 377/754] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:05 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:39:07.016690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:07.017384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:07.020235 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:07.025762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:07.026254 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:07.026737 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:07.027665 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:07.028205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:07.028739 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:07.163703 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:07.171825 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:07.173279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:07.175098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-86a426fe-9ed5-4b20-9743-2a5247ea97c1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.162347 Oct 03 13:39:07.175701 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 378/755] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:07 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:39:08.142316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:08.200122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:08.200729 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:08.208242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:08.208726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:08.209191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:08.209911 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:08.210360 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:08.210785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:08.269802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-db5c9745-13b9-4501-a1db-8c4a60d5d617 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "POST /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.864706 Oct 03 13:39:08.270453 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 378/756] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:39:05 2022] POST /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments => generated 194 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:39:08.379443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:08.388187 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:08.389656 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:08.390811 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a2ab732d-d23e-4c93-9386-38e6232c7a0a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.194548 Oct 03 13:39:08.391412 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 379/757] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:08 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:39:09.424014 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:09.424882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:09.427828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:09.433550 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:09.434044 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:09.434490 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:09.435199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:09.435658 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:09.436091 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:09.579190 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:09.588836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:09.590257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:09.591461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c860dd5b-e0a0-461f-9dc4-7e00bdee72b0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.172490 Oct 03 13:39:09.592026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 379/758] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:09 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:10.618377 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:10.618979 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:10.625654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:10.626130 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:10.626561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:10.628741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:10.629887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:10.630327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:10.767998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:10.779076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:10.780525 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:10.781718 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-86dd5e23-a978-47bc-827c-6ddd02272757 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.167229 Oct 03 13:39:10.782440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 380/759] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:10 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:11.809822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:11.810451 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:11.817652 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:11.818145 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:11.818588 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:11.819294 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:11.819753 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:11.820187 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:11.953983 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:11.963313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:11.964750 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:11.965935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-76d45fa5-6c93-4f7c-bfcc-cdc81262088c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.160207 Oct 03 13:39:11.966502 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 380/760] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:11 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:12.993972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:12.994671 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:13.004666 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:13.005164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:13.005636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:13.006379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:13.006848 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:13.007279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:13.151717 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:13.161623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:13.163084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:13.164289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-12780251-cfc8-41c1-8301-661ac45799c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.175555 Oct 03 13:39:13.164861 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 381/761] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:12 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:14.192599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:14.193433 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:14.204554 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:14.206395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:14.207154 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:14.208360 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:14.209146 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:14.209936 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:14.368152 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:14.383903 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:14.386769 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:14.388956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d90bacb5-6654-4b75-bd52-a0f9569e00e3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.201293 Oct 03 13:39:14.390010 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 381/762] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:14 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:15.416225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:15.417078 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:15.426588 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:15.427285 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:15.427908 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:15.428917 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:15.429597 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:15.430238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:15.596960 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:15.609302 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:15.612185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:15.614290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7c4f57b2-8309-43bd-bafb-62111b607286 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.202034 Oct 03 13:39:15.615268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 382/763] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:15 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:15.869565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:15.871823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:15.879714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:15.880204 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:15.880643 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:15.881346 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:15.881827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:15.882255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:15.926921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-42f0033e-6cef-4a61-a2cd-b749274d2505 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060867 Oct 03 13:39:15.927934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 382/764] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:39:15 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:39:16.073009 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:16.073535 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:16.080273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:16.081004 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:16.081475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:16.082174 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:16.082636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:16.083067 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:16.114887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5fe5794a-56f1-4b22-bcf5-1e16f90ca5c6 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/062c1775-b7e0-4313-ad0f-bed31a3dac7a" status: 200 len: 194 microversion: 2.1 time: 0.045858 Oct 03 13:39:16.115404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 383/765] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Oct 3 13:39:16 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/062c1775-b7e0-4313-ad0f-bed31a3dac7a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:39:16.126100 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:16.127106 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:16.133290 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:16.133807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:16.134247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:16.134928 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:16.135373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:16.135792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:16.224551 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lazy-loading 'services' on Instance uuid f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:39:16.313002 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9e9ddfff-22b9-421c-a505-184267452fa5 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/062c1775-b7e0-4313-ad0f-bed31a3dac7a" status: 202 len: 0 microversion: 2.1 time: 0.190836 Oct 03 13:39:16.313699 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 383/766] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:39:16 2022] DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/062c1775-b7e0-4313-ad0f-bed31a3dac7a => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:39:16.643803 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:16.644367 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:16.651173 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:16.651649 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:16.652076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:16.652760 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:16.653205 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:16.653661 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:16.791378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:16.802754 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:16.805386 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:16.806633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-537dfdb8-e706-4523-932b-ed4f83979ffa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.167051 Oct 03 13:39:16.807203 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 384/767] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:16 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:17.833730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:17.834444 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:17.840759 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:17.841252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:17.841724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:17.842440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:17.843004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:17.843333 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:18.007728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:18.018024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:18.020207 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:18.021787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d3837074-ecc3-4167-b5e5-d458f5236f47 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1743 microversion: 2.20 time: 0.192732 Oct 03 13:39:18.023498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 384/768] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:17 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1743 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:18.512558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:18.513103 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:18.520340 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:18.520833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:18.521265 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:18.522077 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:18.522525 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:18.522957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:18.554472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b9cbae2e-cfa0-47ff-bb91-900c51423eee tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/59fbe6ec-c362-4ad4-8071-bb3562366f53" status: 200 len: 194 microversion: 2.1 time: 0.045852 Oct 03 13:39:18.555071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 385/769] 10.222.0.58 () {58 vars in 1413 bytes} [Mon Oct 3 13:39:18 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/59fbe6ec-c362-4ad4-8071-bb3562366f53 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:39:18.566826 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:18.567338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:18.573901 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:18.574390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:18.574834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:18.575539 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:18.575996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:18.576493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:18.663439 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lazy-loading 'services' on Instance uuid f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:39:18.742862 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9ad317be-54ab-4f50-a3cf-6deac354977e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/59fbe6ec-c362-4ad4-8071-bb3562366f53" status: 202 len: 0 microversion: 2.1 time: 0.180725 Oct 03 13:39:18.743457 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 385/770] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:39:18 2022] DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments/59fbe6ec-c362-4ad4-8071-bb3562366f53 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:39:19.051365 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:19.051978 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:19.057964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:19.058448 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:19.058885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:19.059575 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:19.060029 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:19.060452 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:19.200697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:19.210023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:19.211494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:19.215543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1a4cc776-c1b8-44a3-879d-eebd21d5f05e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1743 microversion: 2.20 time: 0.166404 Oct 03 13:39:19.215543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 386/771] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:19 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:20.087508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:20.090372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-789c6cfd-a1d8-45d0-9a69-d5a39b79e243 req-6c7a7726-4164-4bb0-8d5b-32919c9bf4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703", "name": "network-vif-plugged", "status": "completed", "tag": "a788fb3b-a7c9-4293-adc4-4714a34e7902"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:39:20.091179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:20.098575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.099074 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.099520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.100307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.100950 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.101593 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.104530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-789c6cfd-a1d8-45d0-9a69-d5a39b79e243 req-6c7a7726-4164-4bb0-8d5b-32919c9bf4af service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.105008 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-789c6cfd-a1d8-45d0-9a69-d5a39b79e243 req-6c7a7726-4164-4bb0-8d5b-32919c9bf4af service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.105424 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-789c6cfd-a1d8-45d0-9a69-d5a39b79e243 req-6c7a7726-4164-4bb0-8d5b-32919c9bf4af service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.123697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-789c6cfd-a1d8-45d0-9a69-d5a39b79e243 req-6c7a7726-4164-4bb0-8d5b-32919c9bf4af service nova] Creating event network-vif-plugged:a788fb3b-a7c9-4293-adc4-4714a34e7902 for instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 on hv-cinder-86009 Oct 03 13:39:20.129566 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-789c6cfd-a1d8-45d0-9a69-d5a39b79e243 req-6c7a7726-4164-4bb0-8d5b-32919c9bf4af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042773 Oct 03 13:39:20.130831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 387/772] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:39:20.162533 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1956252d-0b92-4609-bba1-92dfedf3e5e3 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079513 Oct 03 13:39:20.169602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 386/773] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:39:20 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:39:20.239933 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:20.240628 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:20.246871 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.247353 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.247786 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.248484 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.248920 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.249339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.296630 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:20.298979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:20.313114 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.314021 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.314651 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.315802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.316501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.316947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.357263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-763d60d1-3c70-4fdd-92ef-8218b5e1f20d tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064266 Oct 03 13:39:20.358212 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 387/774] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:39:20 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 03 13:39:20.455294 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:20.456309 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:20.463229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.464034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.464742 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.465781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.466303 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.467045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.501612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:20.505320 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:39:20.511780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:20.513334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:20.514619 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9cc863fe-d39b-4cda-a034-af76f6455fd3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.279522 Oct 03 13:39:20.515446 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 388/775] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:20 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:20.613236 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9bd9740e-c4b4-4992-8aef-31b2473aab24 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 204 len: 0 microversion: 2.1 time: 0.164068 Oct 03 13:39:20.613822 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 388/776] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:39:20 2022] DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:39:20.622666 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:20.623355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:20.630936 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.631413 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.631883 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.632653 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:20.633192 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:20.633732 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:20.792524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:20.802813 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fad3d9ee-6d6d-41f0-9b48-aa9715ef382f tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1671 microversion: 2.1 time: 0.184507 Oct 03 13:39:20.803420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 389/777] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:20 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:39:21.543664 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:21.545477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:21.553549 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:21.554301 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:21.555252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:21.556172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:21.556926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:21.557542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:21.732576 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:21.743217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:21.744905 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:21.746181 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5c39a593-306b-40cb-8af7-070c6c8f69f3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.206814 Oct 03 13:39:21.761916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 389/778] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:21 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:21.832709 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:21.833477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:21.842320 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:21.842988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:21.843448 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:21.844293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:21.844761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:21.845957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:22.010506 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:22.020152 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-df4b1dc6-a512-412f-9e36-bde4392b20bf tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1671 microversion: 2.1 time: 0.191813 Oct 03 13:39:22.020749 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 390/779] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:21 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1671 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:39:22.798075 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:22.800316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:22.818370 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:22.822139 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:22.823346 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:22.859522 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:22.859522 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:22.859522 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:23.008458 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:23.017525 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:23.019336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:23.020752 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-175c4f8c-8f73-46b6-9807-e779e8935725 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.236168 Oct 03 13:39:23.021856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 390/780] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:22 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:23.049721 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:23.050459 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:23.059484 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:23.060417 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:23.061111 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:23.062039 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:23.062678 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:23.063102 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:23.332445 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:23.346712 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-87aa7898-677c-4820-866a-fac4851d8f97 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1671 microversion: 2.1 time: 0.301779 Oct 03 13:39:23.348830 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 391/781] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:23 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1671 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:39:24.052851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:24.054343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:24.061687 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:24.062452 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:24.063054 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:24.064903 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:24.065756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:24.066362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:24.085582 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:24.225065 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-d49a0e38-a217-418d-b9ca-58bf854aa80d req-7f734765-8d47-4679-a7d6-dcd854102027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0", "name": "network-vif-deleted", "tag": "4fedd529-0907-4e1f-afe2-2a21d1185f1d"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:39:24.237945 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-d49a0e38-a217-418d-b9ca-58bf854aa80d req-7f734765-8d47-4679-a7d6-dcd854102027 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:24.238841 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-d49a0e38-a217-418d-b9ca-58bf854aa80d req-7f734765-8d47-4679-a7d6-dcd854102027 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:24.239424 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-d49a0e38-a217-418d-b9ca-58bf854aa80d req-7f734765-8d47-4679-a7d6-dcd854102027 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:24.260767 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-d49a0e38-a217-418d-b9ca-58bf854aa80d req-7f734765-8d47-4679-a7d6-dcd854102027 service nova] Creating event network-vif-deleted:4fedd529-0907-4e1f-afe2-2a21d1185f1d for instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 on hv-cinder-86009 Oct 03 13:39:24.273695 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-d49a0e38-a217-418d-b9ca-58bf854aa80d req-7f734765-8d47-4679-a7d6-dcd854102027 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054109 Oct 03 13:39:24.275233 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 392/782] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:39:24.367552 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:24.379588 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:24.380626 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:24.406588 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:24.409004 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:24.412584 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:24.414139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:24.414907 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:24.415616 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:24.415799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:24.420085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:24.421409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5a5f09c8-0b79-4824-a0c2-f6dd935a6cef tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.372992 Oct 03 13:39:24.422059 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 391/783] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:24 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:24.504591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:24.506091 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:24.506716 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:24.507492 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lazy-loading 'fault' on Instance uuid f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:39:24.600140 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:24.612141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1f667896-7c69-46b5-a146-90ae4b27f9ad tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1327 microversion: 2.1 time: 0.242563 Oct 03 13:39:24.612914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 393/784] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:24 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1327 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:39:25.450607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:25.451846 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:25.459372 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:25.460723 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:25.461357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:25.462296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:25.462918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:25.463507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:25.645286 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:25.647573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:25.658707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:25.659435 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:25.659571 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:25.660622 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:25.662293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:25.663352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:25.664372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:25.669015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:25.670670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:25.672007 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5ccbceea-c0c7-414f-8efd-1f4e9972f040 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.226190 Oct 03 13:39:25.686820 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 392/785] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:25 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:25.703353 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:25.703846 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:25.704817 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:25.705283 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lazy-loading 'fault' on Instance uuid f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:39:25.708475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:25.748151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:25.757834 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-14ad86c9-2527-443a-b205-9f7f226b2020 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1327 microversion: 2.1 time: 0.121530 Oct 03 13:39:25.758418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 394/786] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:25 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:39:26.701442 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:26.702885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:26.709694 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:26.710184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:26.710623 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:26.711334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:26.711787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:26.712214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:26.784316 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:26.785109 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:26.792395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:26.792889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:26.793322 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:26.794057 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:26.794519 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:26.795261 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:26.834433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:26.835176 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:26.835762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:26.836403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lazy-loading 'fault' on Instance uuid f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:39:26.911998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4471a60040ca42649f2718fd46659e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432ad4a21624574b8caeaf10f2f8339', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:26.921309 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7b2dce3c-95cd-4c1d-a04d-01803ee3787a tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 200 len: 1327 microversion: 2.1 time: 0.141502 Oct 03 13:39:26.922209 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 395/787] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:26 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:39:26.946839 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:26.961471 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:26.964038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:26.966439 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5d65d876-8b03-421a-a1e1-1e8da5bf1d44 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.268782 Oct 03 13:39:26.968260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 393/788] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:26 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:27.959748 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:27.961617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:27.975573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:27.976480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:27.977139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:27.978090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:27.978761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:27.979393 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:27.998934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:27.999827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:28.002932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] HTTP exception thrown: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Request method failure captured: Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 HTTP/1.1 Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuR4MUA9tWNNFzHaURDO-XM9hOhK-itIeRMN4nfSM5qG_oJln7tHJMrtczcNyi3kkL4yCPbH1_enn4kKDotOMJvDEWTCgjHtTCddABe7qdzwFkg0w78aJLPjMZUAGjPLICJ7qX5ekhLNJ3xxrPZVLy6x53qWNAD97dPoJ18KnCdMyCE Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:39:28.004951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 4471a60040ca42649f2718fd46659e31 Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:28.006568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0'} Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:39:28.007420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:28.008759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:28.009933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:28.009933 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:28.010094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:28.010709 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:28.011164 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:28.011857 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:28.012012 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Returning 404 to user: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:39:28.012923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-dfbb677a-6e19-4efd-a0b5-bac4af0d53f1 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 404 len: 111 microversion: 2.1 time: 0.057331 Oct 03 13:39:28.018125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 396/789] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:27 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:39:28.025147 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cc14ac61-00d5-4c95-84cf-ac0421c6a8e8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '.version_select at 0x7f7c2193a670>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:28.052804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cc14ac61-00d5-4c95-84cf-ac0421c6a8e8 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744805734" status: 202 len: 0 microversion: 2.1 time: 0.033304 Oct 03 13:39:28.053669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 397/790] 10.222.0.58 () {58 vars in 1218 bytes} [Mon Oct 3 13:39:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744805734 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:39:28.248846 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:28.261163 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:28.262731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:28.264480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-41c32fdd-ceb8-4c9c-a7d0-d1b630d6d372 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.274945 Oct 03 13:39:28.281863 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 394/791] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:27 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:29.292252 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:29.293752 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:29.302680 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:29.303207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:29.303647 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:29.304380 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:29.304840 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:29.305274 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:29.449992 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:29.459480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:29.461225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:29.462452 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9e77df42-58c6-4152-9c35-826e9d9706cc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.174780 Oct 03 13:39:29.481022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 398/792] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:29 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:30.489070 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:30.492250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:30.506261 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:30.506966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:30.507503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:30.508236 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:30.508715 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:30.512727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:30.658337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:30.667180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:30.668587 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:30.670308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-df3b5663-7de8-407e-9cc3-8c1105aabdf2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1738 microversion: 2.20 time: 0.185246 Oct 03 13:39:30.670650 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 395/793] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:30 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:31.698150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:31.698833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:31.705707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:31.706697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:31.707276 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:31.707819 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:31.708271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:31.708718 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:32.174181 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:32.184371 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:32.186419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:32.188327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e64e7df4-efbe-42a6-a752-91889f49d819 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1720 microversion: 2.20 time: 0.493939 Oct 03 13:39:32.189999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 399/794] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:31 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1720 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:33.228387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:33.229008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:33.235791 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:33.236288 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:33.236756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:33.238035 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:33.238519 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:33.238956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:33.383053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:33.391634 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:33.393299 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:33.394601 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-92922568-683e-40f0-8074-ac342c3288b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1720 microversion: 2.20 time: 0.170184 Oct 03 13:39:33.395176 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 396/795] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:33 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:33.505086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:33.506020 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:33.513965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:33.514736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:33.515279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:33.516076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:33.517214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:33.517882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:33.544180 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] HTTP exception thrown: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Request method failure captured: Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 HTTP/1.1 Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuR4MUA9tWNNFzHaURDO-XM9hOhK-itIeRMN4nfSM5qG_oJln7tHJMrtczcNyi3kkL4yCPbH1_enn4kKDotOMJvDEWTCgjHtTCddABe7qdzwFkg0w78aJLPjMZUAGjPLICJ7qX5ekhLNJ3xxrPZVLy6x53qWNAD97dPoJ18KnCdMyCE Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:39:33.545781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 4471a60040ca42649f2718fd46659e31 Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.547406 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0'} Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:39:33.548306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.549807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.552284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Returning 404 to user: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:39:33.552284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-532827e1-8f93-4223-9fa0-fd9e36313288 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 404 len: 111 microversion: 2.1 time: 0.047793 Oct 03 13:39:33.552284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 400/796] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:39:33 2022] DELETE /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:39:33.558189 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:33.558929 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:33.565104 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:33.566704 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:33.567153 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:33.567888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:33.568352 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:33.568784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:33.583718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] HTTP exception thrown: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Request method failure captured: Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 HTTP/1.1 Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuR4MUA9tWNNFzHaURDO-XM9hOhK-itIeRMN4nfSM5qG_oJln7tHJMrtczcNyi3kkL4yCPbH1_enn4kKDotOMJvDEWTCgjHtTCddABe7qdzwFkg0w78aJLPjMZUAGjPLICJ7qX5ekhLNJ3xxrPZVLy6x53qWNAD97dPoJ18KnCdMyCE Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:39:33.585388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 4471a60040ca42649f2718fd46659e31 Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.586755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': 'f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0'} Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:39:33.588461 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. Oct 03 13:39:33.590141 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:33.592228 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Returning 404 to user: Instance f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:39:33.592228 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-387f1e04-95c0-40ae-8b0f-deba947e8f7e tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0" status: 404 len: 111 microversion: 2.1 time: 0.032670 Oct 03 13:39:33.592228 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 397/797] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:33 2022] GET /compute/v2.1/servers/f8ca2b3e-05c2-422b-a6ac-8eddcf6fc7f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:39:34.421149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:34.421698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:34.429034 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:34.429560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:34.430003 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:34.430710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:34.431163 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:34.431587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:34.594910 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:34.604062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:34.605578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:34.606708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-de22ca3b-8e56-445c-ad0e-5cfb7522fe85 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1720 microversion: 2.20 time: 0.189690 Oct 03 13:39:34.607251 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 401/798] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:34 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:34.748976 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:34.750266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:34.761633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:34.763354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:34.764121 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:34.765311 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:34.766687 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:34.767446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:34.784940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] HTTP exception thrown: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Request method failure captured: Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 HTTP/1.1 Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuR4MUA9tWNNFzHaURDO-XM9hOhK-itIeRMN4nfSM5qG_oJln7tHJMrtczcNyi3kkL4yCPbH1_enn4kKDotOMJvDEWTCgjHtTCddABe7qdzwFkg0w78aJLPjMZUAGjPLICJ7qX5ekhLNJ3xxrPZVLy6x53qWNAD97dPoJ18KnCdMyCE Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:39:34.787172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 4471a60040ca42649f2718fd46659e31 Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.789885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '2ca377db-f0f6-4888-a94e-cfde65e470e9'} Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:39:34.791499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.793786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.796155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Returning 404 to user: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:39:34.796155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4688ce39-0e9c-4510-b278-5e321f8de3c4 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 404 len: 111 microversion: 2.1 time: 0.048090 Oct 03 13:39:34.796155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 398/799] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:39:34 2022] DELETE /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:39:34.805791 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:34.806918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] [instance: 2ca377db-f0f6-4888-a94e-cfde65e470e9] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:34.818572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:34.819451 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:34.820226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:34.821516 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:34.822366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:34.823164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:34.851286 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] HTTP exception thrown: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Request method failure captured: Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 HTTP/1.1 Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuR4MUA9tWNNFzHaURDO-XM9hOhK-itIeRMN4nfSM5qG_oJln7tHJMrtczcNyi3kkL4yCPbH1_enn4kKDotOMJvDEWTCgjHtTCddABe7qdzwFkg0w78aJLPjMZUAGjPLICJ7qX5ekhLNJ3xxrPZVLy6x53qWNAD97dPoJ18KnCdMyCE Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:39:34.854700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1432ad4a21624574b8caeaf10f2f8339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 1432ad4a21624574b8caeaf10f2f8339 Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17057039 Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 4471a60040ca42649f2718fd46659e31 Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeTestJSON-17057039-project Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.856182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '2ca377db-f0f6-4888-a94e-cfde65e470e9'} Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:39:34.856972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. Oct 03 13:39:34.858191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:39:34.859268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] Returning 404 to user: Instance 2ca377db-f0f6-4888-a94e-cfde65e470e9 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:39:34.859268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f96336da-a223-4d2a-a46b-39a672df6e92 tempest-AttachVolumeTestJSON-17057039 tempest-AttachVolumeTestJSON-17057039-project] 10.222.0.58 "GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9" status: 404 len: 111 microversion: 2.1 time: 0.061067 Oct 03 13:39:34.859268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 402/800] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:39:34 2022] GET /compute/v2.1/servers/2ca377db-f0f6-4888-a94e-cfde65e470e9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:39:35.632690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:35.633268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:35.639340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:35.639835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:35.640308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:35.641047 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:35.641533 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:35.641971 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:35.776660 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:35.785478 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:35.786938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:35.788110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-380f9e51-a828-4a84-88cf-c9daad613ebb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1663 microversion: 2.20 time: 0.160146 Oct 03 13:39:35.788673 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 399/801] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:35 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:35.812948 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49559984-a82b-4dae-8b57-faadae1a1261"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:39:35.816059 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:35.823073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:35.823635 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:35.824167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:35.824931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:35.825497 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:35.825998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:36.198670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-96fb0d92-094b-4bb8-b4a8-547fdf831926 req-6224d628-0ce5-4fc7-9dc9-8f74c6a716f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703", "name": "network-vif-unplugged", "status": "completed", "tag": "a788fb3b-a7c9-4293-adc4-4714a34e7902"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:39:36.213361 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-96fb0d92-094b-4bb8-b4a8-547fdf831926 req-6224d628-0ce5-4fc7-9dc9-8f74c6a716f4 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:36.214246 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-96fb0d92-094b-4bb8-b4a8-547fdf831926 req-6224d628-0ce5-4fc7-9dc9-8f74c6a716f4 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:36.214906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-96fb0d92-094b-4bb8-b4a8-547fdf831926 req-6224d628-0ce5-4fc7-9dc9-8f74c6a716f4 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:36.228699 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.compute.server_external_events [req-96fb0d92-094b-4bb8-b4a8-547fdf831926 req-6224d628-0ce5-4fc7-9dc9-8f74c6a716f4 service nova] Unable to find a host for instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703. Dropping event network-vif-unplugged {{(pid=120742) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 13:39:36.230369 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-96fb0d92-094b-4bb8-b4a8-547fdf831926 req-6224d628-0ce5-4fc7-9dc9-8f74c6a716f4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035681 Oct 03 13:39:36.231240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 400/802] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 03 13:39:36.274891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c41f27c5-d115-4ada-ac34-4a4bb391df72 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.465859 Oct 03 13:39:36.275602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 403/803] 10.222.0.58 () {62 vars in 1364 bytes} [Mon Oct 3 13:39:35 2022] POST /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments => generated 188 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:39:36.492705 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:39:36.493321 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:36.500855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:36.501366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:36.501825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:36.502541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:36.503655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:36.504370 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:36.632982 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120742) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 13:39:36.726784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c0c5064e-4c77-44ac-8a3c-be420cfe1bf9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/action" status: 202 len: 0 microversion: 2.20 time: 0.238150 Oct 03 13:39:36.728237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 401/804] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Oct 3 13:39:36 2022] POST /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:39:36.736217 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:36.738504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:36.744294 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:36.744788 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:36.745239 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:36.745961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:36.746423 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:36.747029 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:36.942542 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:36.952051 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:36.953850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:36.955018 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1dd301b6-9f7e-4937-9bf9-24989ad25e87 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1749 microversion: 2.20 time: 0.222777 Oct 03 13:39:36.969658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 404/805] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:36 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1749 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:37.982276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:37.983123 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:37.995181 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:37.995688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:37.996136 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:37.996862 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:37.997328 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:37.997796 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:38.298171 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:38.309006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:38.310530 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:38.311742 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f107d101-1cf1-4c23-bece-9b1793082933 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1749 microversion: 2.20 time: 0.334694 Oct 03 13:39:38.312320 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 402/806] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:37 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1749 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:39.344238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:39.345832 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:39.350833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:39.357603 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:39.358129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:39.358573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:39.359283 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:39.359740 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:39.360173 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:39.576571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:39.590248 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:39.591984 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:39.593188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-48322872-a859-4823-8cdf-a008c73dcbaa tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1751 microversion: 2.20 time: 0.253284 Oct 03 13:39:39.593842 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 405/807] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:39 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1751 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:39:40.622250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:40.622958 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:40.625620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:40.632431 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:40.632996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:40.633366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:40.634185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:40.634792 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:40.635075 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:40.854569 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:40.864855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:40.866723 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:40.867926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f88f0d85-1806-4802-a347-566eda4d20e9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1751 microversion: 2.20 time: 0.249665 Oct 03 13:39:40.868521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 403/808] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:40 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:41.904259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:41.905072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:41.911970 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:41.912534 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:41.913054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:41.913918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:41.914371 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:41.914790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:42.086457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:42.095297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:42.096740 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:42.097972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b618d4ca-8497-4ae6-a363-2f52651e71a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.198063 Oct 03 13:39:42.098528 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 406/809] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:41 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:43.126052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:43.126679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:43.136663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:43.137155 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:43.137626 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:43.138329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:43.138814 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:43.139231 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:43.413437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:43.428521 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:43.430261 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:43.432567 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9b7b1cf0-dd07-424b-9f24-8a8416b73221 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.310705 Oct 03 13:39:43.447079 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 404/810] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:43 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:44.460278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:44.460885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:44.476971 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:44.477605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:44.478063 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:44.479810 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:44.480323 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:44.480765 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:44.712115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:44.724993 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:44.726934 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:44.728515 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-15cf1459-2045-449c-b073-49884f56bf16 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.272196 Oct 03 13:39:44.746853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 407/811] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:44 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:45.760278 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:45.761823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:45.777287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:45.778852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:45.779587 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:45.781184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:45.782391 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:45.783452 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:46.096802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:46.111396 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:46.117403 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:46.119090 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e849fa5e-650d-4451-be84-51684d422fc0 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.364199 Oct 03 13:39:46.133969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 405/812] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:45 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:47.151914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:47.152720 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:47.195243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:47.198134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:47.201398 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:47.203194 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:47.205777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:47.207706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:47.471596 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:47.503312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:47.505024 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:47.508672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0227c34a-0f62-4e64-8f65-6183270f0e95 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.361962 Oct 03 13:39:47.509267 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 408/813] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:47 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:48.542166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:48.542918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:48.552134 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:48.553172 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:48.554112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:48.555158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:48.555785 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:48.556383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:48.840510 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:48.864120 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:48.865948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:48.867370 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9fe7637c-edba-4a52-aa60-20a5216d9377 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.332155 Oct 03 13:39:48.870657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 406/814] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:48 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:49.914262 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:49.915694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:49.939335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:49.940747 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:49.941370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:49.942309 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:49.943161 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:49.943890 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:50.224076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:50.253285 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:50.269650 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:50.272174 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0977dbbe-5938-4f58-84ed-b687f3da73d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.366276 Oct 03 13:39:50.273700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 409/815] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:49 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:51.302003 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:51.303595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:51.319151 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:51.319789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:51.320316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:51.321251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:51.321831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:51.322276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:51.577186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:51.586661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:51.588178 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:51.589428 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0caabace-65ae-47df-ab4f-d694e95d1ffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.292974 Oct 03 13:39:51.590018 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 407/816] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:51 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:52.617509 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:52.618107 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:52.625155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:52.625876 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:52.626508 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:52.628567 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:52.629539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:52.629972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:52.824220 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:52.833505 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:52.835651 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:52.836847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5385abdc-6e67-4590-899b-60ab96924b24 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.224181 Oct 03 13:39:52.837413 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 410/817] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:52 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:53.867240 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:53.868338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:53.876206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:53.876975 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:53.877698 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:53.878638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:53.879094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:53.879689 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:54.053587 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:54.062410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:54.066625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:54.068138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-13ca876e-78d9-4a2c-9d80-3e07ba0e6610 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.206784 Oct 03 13:39:54.068711 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 408/818] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:53 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:55.094136 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:55.095099 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:55.102280 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:55.102771 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:55.103215 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:55.103921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:55.104382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:55.104809 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:55.109199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:55.250065 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:55.259238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:55.260574 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:55.261813 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ddc4fff7-2cb5-4efe-8289-85b8cbae5db3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.171723 Oct 03 13:39:55.262384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 411/819] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:55 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:56.289015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:56.290301 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:56.301307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:56.301842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:56.302302 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:56.303020 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:56.303483 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:56.303921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:56.306934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:39:56.485308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:56.495476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:56.496974 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:56.498276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f46da988-d9f1-4336-a3ec-b5d258717c86 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.214256 Oct 03 13:39:56.501319 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 409/820] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:56 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:39:57.526771 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:57.527772 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:57.539204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:57.539204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:57.539204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:57.539802 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:57.540056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:57.540576 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:57.800789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:57.813231 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:57.815642 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:57.817175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f22c4667-89cc-436f-99b1-d1bc1f0a5383 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.295363 Oct 03 13:39:57.831116 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 412/821] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:57 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:39:58.844708 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:39:58.845306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:39:58.852730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:58.853222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:58.853689 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:58.854403 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:39:58.854838 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:39:58.855258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:39:59.016952 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:59.026850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:59.028367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:39:59.029583 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-57640eb9-fa64-4cbe-b227-409732eeaefb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.188771 Oct 03 13:39:59.030235 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 410/822] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:39:58 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:00.064284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:00.065713 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:00.073750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:00.074093 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:00.074710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:00.075842 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:00.076388 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:00.077050 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:00.306005 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:00.320026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:00.321524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:00.322954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7c5c5e9f-5d55-435e-bfbd-3c1db3bf491b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.267500 Oct 03 13:40:00.329771 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 413/823] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:00 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:01.353540 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:01.355052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:01.366848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:01.368227 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:01.370032 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:01.372290 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:01.373142 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:01.374247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:01.393125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-f82bbba7-be06-414b-9e42-36bdd545f229 req-fcb946f0-cbc5-42c9-a3b3-0c04bf3b768d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703", "name": "network-vif-plugged", "status": "completed", "tag": "a788fb3b-a7c9-4293-adc4-4714a34e7902"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:40:01.427282 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f82bbba7-be06-414b-9e42-36bdd545f229 req-fcb946f0-cbc5-42c9-a3b3-0c04bf3b768d service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:01.428181 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f82bbba7-be06-414b-9e42-36bdd545f229 req-fcb946f0-cbc5-42c9-a3b3-0c04bf3b768d service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:01.429119 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f82bbba7-be06-414b-9e42-36bdd545f229 req-fcb946f0-cbc5-42c9-a3b3-0c04bf3b768d service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:01.463307 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-f82bbba7-be06-414b-9e42-36bdd545f229 req-fcb946f0-cbc5-42c9-a3b3-0c04bf3b768d service nova] Creating event network-vif-plugged:a788fb3b-a7c9-4293-adc4-4714a34e7902 for instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 on hv-cinder-86009 Oct 03 13:40:01.471292 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-f82bbba7-be06-414b-9e42-36bdd545f229 req-fcb946f0-cbc5-42c9-a3b3-0c04bf3b768d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089800 Oct 03 13:40:01.472820 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 414/824] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:40:01.586269 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:01.599464 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:01.601377 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:01.602640 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7f1fbd51-0d43-48fb-8c6c-487ed924aee2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.254944 Oct 03 13:40:01.617060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 411/825] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:01 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:02.635016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:02.636227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:02.649700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:02.650623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:02.651624 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:02.653096 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:02.654082 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:02.655093 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:02.894263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:02.905641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:02.907370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:02.908649 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4250a126-d3a8-4147-b06a-d89aae5dfffb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.279755 Oct 03 13:40:02.926037 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 415/826] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:02 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:03.935463 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:03.936229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:03.946252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:03.947020 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:03.947613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:03.948406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:03.948903 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:03.949410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:04.139472 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:04.152654 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:04.155309 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:04.158018 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f44885bf-8637-4090-b176-e2434235d470 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1807 microversion: 2.20 time: 0.226656 Oct 03 13:40:04.175565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 412/827] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:03 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:05.202898 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:05.203551 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:05.212655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:05.213157 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:05.213684 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:05.214434 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:05.214889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:05.215317 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:05.375227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:05.385605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:05.387111 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:05.388534 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9dcc15c4-a4a0-4372-8faf-507b4c76fb3e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1794 microversion: 2.20 time: 0.189793 Oct 03 13:40:05.388949 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 416/828] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:05 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1794 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:28.202878 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=19 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:28.205079 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=23 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:28.581598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-71409811-c188-4daf-906e-c264df6d0195 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Action: 'create', calling method: .version_select at 0x7f7c21855310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2088345513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs/UeQC8Ar0pne8sxQlQdXLUTbw236MJWy/80WJSXbm0xXRba9gSFvQRNgtYOxBR8g3oAALCydw6vWGbs1o/FjXh55J9LDkkVhdIwDFXnFikci8dEu1Jo/NSni4GjBjQA=="}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:40:28.619543 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-71409811-c188-4daf-906e-c264df6d0195 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Getting quotas for project 0e005cbca8874c76bf8ad8f5d336b189. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:40:28.630807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-71409811-c188-4daf-906e-c264df6d0195 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Getting quotas for user f548ccf8c5a14b108aa8b851560139d0 and project 0e005cbca8874c76bf8ad8f5d336b189. Resources: {'key_pairs'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:40:28.675369 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-71409811-c188-4daf-906e-c264df6d0195 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.475793 Oct 03 13:40:28.676479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 413/829] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:40:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:40:44.465693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:44.466688 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:44.472869 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=23 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:44.474048 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=30 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:44.480698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:44.481271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:44.482038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:44.482855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:44.483322 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:44.483753 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:44.518807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d6ed06f8-b219-4aad-8612-af23c11ea12b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments/49559984-a82b-4dae-8b57-faadae1a1261" status: 200 len: 194 microversion: 2.20 time: 0.065281 Oct 03 13:40:44.519416 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 417/830] 10.222.0.58 () {60 vars in 1454 bytes} [Mon Oct 3 13:40:44 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments/49559984-a82b-4dae-8b57-faadae1a1261 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 13:40:44.593763 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:44.594542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:40:44.599531 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:44.600038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:44.607854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:44.608157 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:44.608598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:44.611079 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:44.611079 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:44.611079 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:44.876833 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lazy-loading 'services' on Instance uuid 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:40:44.970902 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b3c96513-8ae1-4e74-a203-4a46f015d9fc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments/49559984-a82b-4dae-8b57-faadae1a1261" status: 202 len: 0 microversion: 2.20 time: 0.378197 Oct 03 13:40:44.971510 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 414/831] 10.222.0.58 () {60 vars in 1457 bytes} [Mon Oct 3 13:40:44 2022] DELETE /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments/49559984-a82b-4dae-8b57-faadae1a1261 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 13:40:44.980167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:44.982453 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:44.989675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:44.990165 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:44.990600 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:44.991384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:44.991913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:44.992551 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:45.035701 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f3dc68c1-bf4a-4b1d-a49d-491007efde07 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059007 Oct 03 13:40:45.038323 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 418/832] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 3 13:40:44 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 03 13:40:46.057965 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:46.062592 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:46.077154 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:46.078315 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:46.079842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:46.081236 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:46.082034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:46.083127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:46.160915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a57850af-8e31-4852-8dd8-66c1126820a6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.111103 Oct 03 13:40:46.181587 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 415/833] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 3 13:40:46 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:40:46.280612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:46.281500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:46.291904 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:46.293234 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:46.294100 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:46.294941 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:46.295660 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:46.296292 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:46.340826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:40:46.498311 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-71efc347-3b0f-4ab4-9b46-e6b7536bab46 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 204 len: 0 microversion: 2.20 time: 0.220728 Oct 03 13:40:46.500849 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 419/834] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Oct 3 13:40:46 2022] DELETE /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 13:40:46.514996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:46.515618 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:46.530749 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:46.531457 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:46.532645 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:46.533750 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:46.534431 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:46.534998 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:46.728861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:46.750160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:46.755474 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:46.762015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-dbbbb10b-e708-47a2-8c6d-fbcf4bc62d9c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.255226 Oct 03 13:40:46.763138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 416/835] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:46 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:40:47.801834 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:47.802537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:47.808966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:47.809442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:47.809899 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:47.810591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:47.811038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:47.811457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:48.154360 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:48.163512 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:48.164961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:48.166164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-074c0911-2ae6-490b-929f-dba407151038 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.369447 Oct 03 13:40:48.166727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 420/836] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:47 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:49.192948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:49.193927 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:49.200820 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:49.201318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:49.201821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:49.202563 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:49.203020 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:49.203573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:49.351173 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:49.363615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:49.365306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:49.368076 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-16f13281-f935-4fb5-b45e-17045734b96f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1722 microversion: 2.20 time: 0.178329 Oct 03 13:40:49.368865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 417/837] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:49 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:49.603015 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-860401221", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2088345513", "security_groups": [{"name": "tempest-secgroup-smoke-1836367322"}], "block_device_mapping_v2": [{"uuid": "baeb9336-c0c3-4fe5-8ee2-d6c984dd462e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b3c6d8a-02a1-4730-82ca-c02b5cbef660"}]}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:40:49.770125 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] validate_networks() for [('5b3c6d8a-02a1-4730-82ca-c02b5cbef660', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:40:50.399082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:50.400862 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:50.419301 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:50.419935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:50.420625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:50.421727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:50.423139 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:50.423801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:50.496143 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:40:50.496930 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:40:50.497513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:40:50.500787 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:40:50.501606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:40:50.548366 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:50.548775 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:50.549278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:50.550137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:50.550624 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:50.551058 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:50.582744 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:50.589444 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Getting quotas for project 0e005cbca8874c76bf8ad8f5d336b189. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:40:50.593941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:50.595576 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Getting quotas for user f548ccf8c5a14b108aa8b851560139d0 and project 0e005cbca8874c76bf8ad8f5d336b189. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:40:50.597308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:50.599214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-fccc3e3f-c29a-4a6d-bbd2-97b5afdb8ca8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 200 len: 1654 microversion: 2.20 time: 0.207101 Oct 03 13:40:50.600515 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 418/838] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:50 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 1654 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:50.605776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-ad59108f-6256-4d15-b30a-19c7239fac95 req-98425494-b1bb-4d79-bada-0ea802393083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703", "name": "network-vif-deleted", "tag": "a788fb3b-a7c9-4293-adc4-4714a34e7902"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:40:50.616910 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ad59108f-6256-4d15-b30a-19c7239fac95 req-98425494-b1bb-4d79-bada-0ea802393083 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:50.617930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ad59108f-6256-4d15-b30a-19c7239fac95 req-98425494-b1bb-4d79-bada-0ea802393083 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:50.618598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ad59108f-6256-4d15-b30a-19c7239fac95 req-98425494-b1bb-4d79-bada-0ea802393083 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:50.635089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-ad59108f-6256-4d15-b30a-19c7239fac95 req-98425494-b1bb-4d79-bada-0ea802393083 service nova] Creating event network-vif-deleted:a788fb3b-a7c9-4293-adc4-4714a34e7902 for instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 on hv-cinder-86009 Oct 03 13:40:50.642754 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-ad59108f-6256-4d15-b30a-19c7239fac95 req-98425494-b1bb-4d79-bada-0ea802393083 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040333 Oct 03 13:40:50.647671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 419/839] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:40:50.687773 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:40:50.691053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='baeb9336-c0c3-4fe5-8ee2-d6c984dd462e',volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:40:50.844427 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR oslo.messaging._drivers.impl_rabbit [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [5c36ab64-fd8f-4ed8-9acb-c6d70b048951] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 13:40:51.635597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:51.636318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:51.647129 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:51.647632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:51.648079 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:51.648790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:51.649243 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:51.649723 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:51.664411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] HTTP exception thrown: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Request method failure captured: Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 HTTP/1.1 Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuWtBn7G_RD_mHziKk5eXso1mooUH3PDvh8qOtj8TuZBexfYr4U_uf4Ffe8IlqlnRrFj5ybxCf_-QdHtSmhsCltUVW_U1GI1NCe7_fbx5LRnHEyJEs2aF7VZMzkt0rCUW7wdrr13hBQlTPnHth5zSktDZmqw2NnjcoUvZuU1ThdMtCA Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:40:51.666119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 21fde7fa2a16426890bdcba2241778ed Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:40:51.667970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703'} Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:40:51.669057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:40:51.670469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:40:51.671924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Returning 404 to user: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:40:51.671924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b3eb1eee-f247-441e-8d9d-7d407db4d270 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 404 len: 111 microversion: 2.20 time: 0.036673 Oct 03 13:40:51.671924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 420/840] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:51 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:40:51.677997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-260e8f74-a3e2-4baa-88be-f38d0a90f3d1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '.version_select at 0x7f7c2188bb80>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:51.708455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-260e8f74-a3e2-4baa-88be-f38d0a90f3d1 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-189810902" status: 204 len: 0 microversion: 2.20 time: 0.035379 Oct 03 13:40:51.709239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 421/841] 10.222.0.58 () {60 vars in 1259 bytes} [Mon Oct 3 13:40:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-189810902 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 13:40:51.854141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [5c36ab64-fd8f-4ed8-9acb-c6d70b048951] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 45460. Oct 03 13:40:51.859360 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-44d06602-d1dc-42c9-bdf4-668cc2516d2c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.260325 Oct 03 13:40:51.860242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 421/842] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:40:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:40:51.873881 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9eeeb061-eeed-4e1c-ba97-09d5506e2382 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:51.876033 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9eeeb061-eeed-4e1c-ba97-09d5506e2382 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:51.947529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9eeeb061-eeed-4e1c-ba97-09d5506e2382 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:51.956932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9eeeb061-eeed-4e1c-ba97-09d5506e2382 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1094 microversion: 2.1 time: 0.088498 Oct 03 13:40:51.957553 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 422/843] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:40:51 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:40:52.410378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7af85f0c-19af-4b46-83fd-d0c30cd64e14 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'create', calling method: .version_select at 0x7f7c219b1ee0>, body: {"keypair": {"name": "tempest-keypair-1460172710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfEoM9ztqQUQMKq75SJ2pV517dOaKmxGpzTOwdeTQ8JO+LlPaGucqd2vgx/G7KDnt6HL7RQ0YKwnAs10ditJqXrv3m+0/sYYRPj8TdKqth0DHvBQESwYaUEbUxdk85Mpg=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:40:52.427932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-7af85f0c-19af-4b46-83fd-d0c30cd64e14 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Getting quotas for project e019f687769f408d9c3faab0c8693a9d. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:40:52.434134 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-7af85f0c-19af-4b46-83fd-d0c30cd64e14 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Getting quotas for user 21fde7fa2a16426890bdcba2241778ed and project e019f687769f408d9c3faab0c8693a9d. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:40:52.463606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7af85f0c-19af-4b46-83fd-d0c30cd64e14 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.058473 Oct 03 13:40:52.464311 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 422/844] 10.222.0.58 () {62 vars in 1200 bytes} [Mon Oct 3 13:40:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 03 13:40:52.979831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ec9a1ccc-c29f-4c1b-b8d2-0ce09f58be04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:52.980656 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ec9a1ccc-c29f-4c1b-b8d2-0ce09f58be04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:53.038515 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ec9a1ccc-c29f-4c1b-b8d2-0ce09f58be04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:53.046524 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ec9a1ccc-c29f-4c1b-b8d2-0ce09f58be04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1094 microversion: 2.1 time: 0.070502 Oct 03 13:40:53.047118 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 423/845] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:40:52 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:40:53.960755 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2106585670", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83166103-7560-4ace-bfbe-05a1216e31b8"}], "security_groups": [{"name": "tempest-securitygroup--1576754660"}], "key_name": "tempest-keypair-1460172710", "user_data": "}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:40:54.074565 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-be72ed6b-2902-42ec-acc7-a029ddcf1c6a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:54.075873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-be72ed6b-2902-42ec-acc7-a029ddcf1c6a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:54.088852 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.network.neutron [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] validate_networks() for [('83166103-7560-4ace-bfbe-05a1216e31b8', None, None, None, None, None)] {{(pid=120743) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:40:54.147557 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-be72ed6b-2902-42ec-acc7-a029ddcf1c6a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:54.160553 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-be72ed6b-2902-42ec-acc7-a029ddcf1c6a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1094 microversion: 2.1 time: 0.090419 Oct 03 13:40:54.162411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 424/846] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:40:54 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:40:54.540775 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Flavor limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:40:54.541204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Image limits 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:40:54.541758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Flavor pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:40:54.542164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Image pref 0:0:0 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:40:54.542575 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.virt.hardware [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:40:54.552509 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:54.552999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:54.553439 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:54.554222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:54.554682 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:54.555107 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:54.574397 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Getting quotas for project e019f687769f408d9c3faab0c8693a9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:40:54.578547 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Getting quotas for user 21fde7fa2a16426890bdcba2241778ed and project e019f687769f408d9c3faab0c8693a9d. Resources: {'ram', 'instances', 'cores'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:40:54.591955 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Going to run 1 instances... {{(pid=120743) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:40:54.594373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:40:54.652676 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9bcefb2b-56c2-45c7-876e-e4153b370abb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.696807 Oct 03 13:40:54.653666 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 423/847] 10.222.0.58 () {62 vars in 1188 bytes} [Mon Oct 3 13:40:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 03 13:40:54.670889 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ed271f7a-dd45-4ada-8d02-c96f982dd2ea tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:54.671999 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ed271f7a-dd45-4ada-8d02-c96f982dd2ea tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:54.746865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ed271f7a-dd45-4ada-8d02-c96f982dd2ea tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:54.755491 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ed271f7a-dd45-4ada-8d02-c96f982dd2ea tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:54.756969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ed271f7a-dd45-4ada-8d02-c96f982dd2ea tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:54.758279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ed271f7a-dd45-4ada-8d02-c96f982dd2ea tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1282 microversion: 2.20 time: 0.093735 Oct 03 13:40:54.758855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 425/848] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:54 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:55.194038 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9180109a-f440-4810-aeed-4dee027ac77b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:55.194676 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9180109a-f440-4810-aeed-4dee027ac77b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:55.290295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9180109a-f440-4810-aeed-4dee027ac77b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:55.306068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9180109a-f440-4810-aeed-4dee027ac77b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1094 microversion: 2.1 time: 0.123561 Oct 03 13:40:55.306613 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 424/849] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:40:55 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:40:55.792536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:55.793595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:55.802338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:55.803035 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:55.803553 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:55.804542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:55.805137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:55.805695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:55.885018 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:55.898498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:55.900187 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:55.901340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-55cd35f8-421e-4f35-aa69-7e18107fe05c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1334 microversion: 2.20 time: 0.113037 Oct 03 13:40:55.902175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 426/850] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:55 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1334 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:56.357172 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:56.358319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:56.371602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:56.372417 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:56.373214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:56.374762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:56.375595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:56.376526 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:56.477640 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:56.492707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-581ca883-2d43-4876-b1e5-3d1403cf1a49 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1144 microversion: 2.1 time: 0.142531 Oct 03 13:40:56.493958 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 425/851] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:40:56 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1144 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:40:56.929393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:56.930200 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:56.938787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:56.939376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:56.939897 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:56.940691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:56.941223 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:56.941754 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:57.153291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:57.163128 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:57.165087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:57.166606 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3d411991-85b7-4d23-b527-218ca0044b8f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1408 microversion: 2.20 time: 0.241718 Oct 03 13:40:57.167482 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 427/852] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:56 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:40:57.526966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:57.528248 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:57.536080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:57.536574 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:57.537018 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:57.537785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:57.538243 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:57.538675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:57.803135 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:57.822164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0119e04a-23f6-4b3a-8fb0-2502ba0dfb21 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1210 microversion: 2.1 time: 0.300426 Oct 03 13:40:57.823426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 426/853] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:40:57 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1210 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:40:58.192970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:58.193638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:58.200665 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:58.201166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:58.201659 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:58.202401 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:58.202917 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:58.205101 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:58.383545 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:58.393322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:58.395047 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:58.396452 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0ee5d164-3e3d-4b65-85e8-e88435517e8a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1408 microversion: 2.20 time: 0.207817 Oct 03 13:40:58.406200 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 428/854] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:58 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:40:58.717348 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-f9ee4430-b2fc-43c1-a570-30645352d607 req-a2e61535-d09f-45f9-add1-6f0be1d451d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f2c44c-5352-4768-99bc-0cb9f51170ed", "tag": "6728ff97-c99a-4882-be05-9f48cc629cff"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:40:58.739149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f9ee4430-b2fc-43c1-a570-30645352d607 req-a2e61535-d09f-45f9-add1-6f0be1d451d0 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:58.740138 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f9ee4430-b2fc-43c1-a570-30645352d607 req-a2e61535-d09f-45f9-add1-6f0be1d451d0 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:58.741002 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-f9ee4430-b2fc-43c1-a570-30645352d607 req-a2e61535-d09f-45f9-add1-6f0be1d451d0 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:58.763213 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-f9ee4430-b2fc-43c1-a570-30645352d607 req-a2e61535-d09f-45f9-add1-6f0be1d451d0 service nova] Creating event network-changed:6728ff97-c99a-4882-be05-9f48cc629cff for instance 26f2c44c-5352-4768-99bc-0cb9f51170ed on hv-cinder-86009 Oct 03 13:40:58.772996 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-f9ee4430-b2fc-43c1-a570-30645352d607 req-a2e61535-d09f-45f9-add1-6f0be1d451d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066161 Oct 03 13:40:58.774053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 427/855] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:40:58.848364 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:58.849343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:58.860721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:58.861791 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:58.862654 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:58.864023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:58.864977 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:58.865912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:59.082592 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:59.094067 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-927d45bb-94bc-4c61-8dec-d59e8520424d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.251076 Oct 03 13:40:59.096914 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 429/856] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:40:58 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:40:59.426250 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:40:59.427221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:40:59.435382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:59.435981 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:59.436321 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:59.437287 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:40:59.437776 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:40:59.438582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:40:59.671671 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:59.683510 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:59.686588 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:40:59.688814 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-da03e2b0-ed65-4242-a1d6-3c3543b25af3 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1408 microversion: 2.20 time: 0.269146 Oct 03 13:40:59.689859 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 428/857] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:40:59 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:41:00.128560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:00.129186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:00.136747 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:00.137244 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:00.137724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:00.138429 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:00.138884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:00.139307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:00.280385 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:00.289419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b8349571-6f76-4473-858a-755b558cf505 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.165232 Oct 03 13:41:00.290060 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 430/858] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:00 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:41:00.716233 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:00.717064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:00.723914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:00.724407 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:00.724851 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:00.725606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:00.726066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:00.726504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:00.800455 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-ab72f3d9-4c4c-4c2d-98d1-215f0bbedca2 req-79fc0f15-6e83-4614-9116-5840ce4607ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846b1cfd-b06e-4af7-9429-bb095737877a", "tag": "16ed99f4-5dbe-4876-92a3-cebcc2442f10"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:41:00.810606 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ab72f3d9-4c4c-4c2d-98d1-215f0bbedca2 req-79fc0f15-6e83-4614-9116-5840ce4607ec service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:00.811099 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ab72f3d9-4c4c-4c2d-98d1-215f0bbedca2 req-79fc0f15-6e83-4614-9116-5840ce4607ec service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:00.811542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-ab72f3d9-4c4c-4c2d-98d1-215f0bbedca2 req-79fc0f15-6e83-4614-9116-5840ce4607ec service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:00.825946 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-ab72f3d9-4c4c-4c2d-98d1-215f0bbedca2 req-79fc0f15-6e83-4614-9116-5840ce4607ec service nova] Creating event network-changed:16ed99f4-5dbe-4876-92a3-cebcc2442f10 for instance 846b1cfd-b06e-4af7-9429-bb095737877a on hv-cinder-86009 Oct 03 13:41:00.831651 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-ab72f3d9-4c4c-4c2d-98d1-215f0bbedca2 req-79fc0f15-6e83-4614-9116-5840ce4607ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035646 Oct 03 13:41:00.832272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 431/859] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:41:01.051142 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:01.062145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:01.064469 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:01.065569 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2b18cabc-83c9-494b-8790-80ed0efd0a84 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1408 microversion: 2.20 time: 0.353233 Oct 03 13:41:01.066162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 429/860] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:41:00 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:41:01.315811 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:01.316713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:01.323503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:01.324028 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:01.324475 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:01.325183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:01.325692 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:01.326119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:01.473875 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:01.491166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-fe4672e0-4f1d-4a90-bc73-09d715f99a3d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.181467 Oct 03 13:41:01.491765 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 432/861] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:01 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:41:02.090865 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:02.091494 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:02.099897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:02.100373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:02.100816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:02.101537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:02.101989 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:02.102439 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:02.250907 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:02.259123 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:02.260617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:02.261758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b17e9fa2-6500-4528-b5be-ce6519e125a8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1408 microversion: 2.20 time: 0.174961 Oct 03 13:41:02.262321 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 430/862] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:41:02 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:41:02.514459 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:02.515489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:02.524081 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:02.524676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:02.525156 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:02.525891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:02.526348 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:02.526776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:02.674097 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:02.682022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6702f11d-ea83-4d95-bd33-ff5804f6b006 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.171748 Oct 03 13:41:02.682612 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 433/863] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:02 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:41:03.287383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:03.288017 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:03.294601 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:03.295087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:03.295561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:03.296301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:03.296761 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:03.297184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:03.429804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:03.438185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:03.440441 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:03.441590 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bcb1b74d-be81-46e7-ba18-a8d0d0f82795 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1408 microversion: 2.20 time: 0.158884 Oct 03 13:41:03.442141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 431/864] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:41:03 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:41:03.705532 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:03.706222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:03.712926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:03.713414 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:03.713879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:03.714597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:03.715053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:03.715489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:03.866326 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:03.874883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8cdcb987-dea7-47ac-afa7-da48e1767853 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.173213 Oct 03 13:41:03.875793 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 434/865] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:03 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:41:03.962863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-82f8b12a-da3f-42ff-a67b-d6fa53ba2efe req-873aac3c-24f7-4924-8112-7cfb1e6d71ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f2c44c-5352-4768-99bc-0cb9f51170ed", "name": "network-vif-plugged", "status": "completed", "tag": "6728ff97-c99a-4882-be05-9f48cc629cff"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:41:03.973684 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-82f8b12a-da3f-42ff-a67b-d6fa53ba2efe req-873aac3c-24f7-4924-8112-7cfb1e6d71ec service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:03.974192 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-82f8b12a-da3f-42ff-a67b-d6fa53ba2efe req-873aac3c-24f7-4924-8112-7cfb1e6d71ec service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:03.975252 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-82f8b12a-da3f-42ff-a67b-d6fa53ba2efe req-873aac3c-24f7-4924-8112-7cfb1e6d71ec service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:03.987874 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-82f8b12a-da3f-42ff-a67b-d6fa53ba2efe req-873aac3c-24f7-4924-8112-7cfb1e6d71ec service nova] Creating event network-vif-plugged:6728ff97-c99a-4882-be05-9f48cc629cff for instance 26f2c44c-5352-4768-99bc-0cb9f51170ed on hv-cinder-86009 Oct 03 13:41:03.992966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-82f8b12a-da3f-42ff-a67b-d6fa53ba2efe req-873aac3c-24f7-4924-8112-7cfb1e6d71ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034197 Oct 03 13:41:03.993779 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 432/866] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:41:04.467132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:04.467756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:04.474486 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:04.474976 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:04.475418 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:04.476132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:04.476590 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:04.477024 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:04.616426 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:04.627976 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:04.629729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:04.630937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-32c0a58f-f6a9-48d7-bcd6-ee81c3cb4830 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1408 microversion: 2.20 time: 0.167810 Oct 03 13:41:04.631525 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 435/867] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:41:04 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:41:04.899248 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:04.900195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:04.902858 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:04.910721 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:04.911242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:04.911690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:04.912479 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:04.913011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:04.913523 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:05.053817 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:05.062393 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-eea3ce2d-2495-4a48-bcc8-75cad732bb41 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.167698 Oct 03 13:41:05.062997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 433/868] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:04 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:41:05.657261 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:05.658541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:05.661063 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=8 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:05.667051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:05.667544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:05.667980 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:05.668721 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:05.669177 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:05.669633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:05.807922 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:05.811386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:05.818008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:05.819466 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:05.820853 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8e4d52fb-7996-4546-83aa-79c58d5cc75d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1599 microversion: 2.20 time: 0.167994 Oct 03 13:41:05.821423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 436/869] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:41:05 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:41:05.846482 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:05.846979 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:05.848923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=18 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:05.854560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:05.855062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:05.855503 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:05.856210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:05.856668 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:05.857098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:05.936604 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1aa878fd-eb4f-4781-8be4-a2f764a680b5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094115 Oct 03 13:41:05.937226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 434/870] 10.222.0.58 () {60 vars in 1316 bytes} [Mon Oct 3 13:41:05 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:41:06.085959 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:06.086748 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:06.093878 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:06.094371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:06.094811 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:06.095586 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:06.096039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:06.096462 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:06.274827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:06.289494 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e64ccdde-f9d3-4864-b940-1c1e06fc6f93 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.207046 Oct 03 13:41:06.290490 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 437/871] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:06 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:41:07.290728 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-5e34e9e5-d43d-4d9e-943e-d586305c85fb req-c1f728f0-7288-4641-8c53-c3f0f9ce1455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f2c44c-5352-4768-99bc-0cb9f51170ed", "tag": "6728ff97-c99a-4882-be05-9f48cc629cff"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:41:07.300580 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5e34e9e5-d43d-4d9e-943e-d586305c85fb req-c1f728f0-7288-4641-8c53-c3f0f9ce1455 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:07.301071 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5e34e9e5-d43d-4d9e-943e-d586305c85fb req-c1f728f0-7288-4641-8c53-c3f0f9ce1455 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:07.301549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5e34e9e5-d43d-4d9e-943e-d586305c85fb req-c1f728f0-7288-4641-8c53-c3f0f9ce1455 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:07.314486 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-5e34e9e5-d43d-4d9e-943e-d586305c85fb req-c1f728f0-7288-4641-8c53-c3f0f9ce1455 service nova] Creating event network-changed:6728ff97-c99a-4882-be05-9f48cc629cff for instance 26f2c44c-5352-4768-99bc-0cb9f51170ed on hv-cinder-86009 Oct 03 13:41:07.320327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-5e34e9e5-d43d-4d9e-943e-d586305c85fb req-c1f728f0-7288-4641-8c53-c3f0f9ce1455 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034058 Oct 03 13:41:07.321595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 435/872] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:41:07.321813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:07.323404 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:07.335796 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:07.336953 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:07.337882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:07.339287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:07.339989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:07.340824 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:07.540313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:07.548990 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-45752095-678c-4627-9895-abb988b37b4b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.237462 Oct 03 13:41:07.555663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 438/873] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:07 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:41:08.576129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:08.577112 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:08.584133 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:08.584714 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:08.585417 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:08.586604 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:08.587153 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:08.587636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:08.758224 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:08.772576 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2a80f72d-05bb-449c-b0d4-aca7067b8ee9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.201784 Oct 03 13:41:08.774137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 436/874] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:08 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:41:09.797768 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:09.798904 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:09.804782 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:09.805263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:09.805733 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:09.806426 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:09.806877 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:09.807303 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:09.953638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:09.963318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-016b8fef-9a57-40e9-a497-2bebc3fea277 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.169769 Oct 03 13:41:09.963870 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 439/875] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:09 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:41:09.981684 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-3bff82b4-145c-4b24-b47f-7de705dde3e3 req-920dab1d-3fa6-41d6-9408-e986cb2213f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846b1cfd-b06e-4af7-9429-bb095737877a", "name": "network-vif-plugged", "status": "completed", "tag": "16ed99f4-5dbe-4876-92a3-cebcc2442f10"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:41:09.992166 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3bff82b4-145c-4b24-b47f-7de705dde3e3 req-920dab1d-3fa6-41d6-9408-e986cb2213f5 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:09.992572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3bff82b4-145c-4b24-b47f-7de705dde3e3 req-920dab1d-3fa6-41d6-9408-e986cb2213f5 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:09.992999 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3bff82b4-145c-4b24-b47f-7de705dde3e3 req-920dab1d-3fa6-41d6-9408-e986cb2213f5 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:10.004660 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-3bff82b4-145c-4b24-b47f-7de705dde3e3 req-920dab1d-3fa6-41d6-9408-e986cb2213f5 service nova] Creating event network-vif-plugged:16ed99f4-5dbe-4876-92a3-cebcc2442f10 for instance 846b1cfd-b06e-4af7-9429-bb095737877a on hv-cinder-86009 Oct 03 13:41:10.010145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-3bff82b4-145c-4b24-b47f-7de705dde3e3 req-920dab1d-3fa6-41d6-9408-e986cb2213f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041846 Oct 03 13:41:10.010911 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 437/876] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:41:10.988132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:10.988714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:10.997354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:10.997927 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:10.998366 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:10.999281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:11.000105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:11.000534 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:11.140192 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:11.148341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a3546af6-f559-454f-bf5c-0e37127a210c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1266 microversion: 2.1 time: 0.165114 Oct 03 13:41:11.148931 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 440/877] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:10 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:41:12.173225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:12.174539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:12.180785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:12.181269 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:12.181736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:12.182457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:12.182890 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:12.183317 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:12.187315 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:12.324751 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:12.333974 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f0755959-5676-4319-8e02-1ae940044c8b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1453 microversion: 2.1 time: 0.165419 Oct 03 13:41:12.334561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 438/878] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:12 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:41:12.356646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:12.357266 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:12.364033 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:12.364527 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:12.364979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:12.365830 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:12.366202 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:12.366634 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:12.507914 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:12.516300 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4bc7ef7b-fe70-4213-988c-a314ecbe155f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1453 microversion: 2.1 time: 0.163411 Oct 03 13:41:12.516898 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 441/879] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:41:12 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:41:14.605654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-7f7eeffd-864a-400e-9d6c-84d38677dc67 req-aaea396f-033c-47e1-a317-b800efcde4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846b1cfd-b06e-4af7-9429-bb095737877a", "tag": "16ed99f4-5dbe-4876-92a3-cebcc2442f10"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:41:14.611325 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:14.617496 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7f7eeffd-864a-400e-9d6c-84d38677dc67 req-aaea396f-033c-47e1-a317-b800efcde4e4 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:14.617973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7f7eeffd-864a-400e-9d6c-84d38677dc67 req-aaea396f-033c-47e1-a317-b800efcde4e4 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:14.618416 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7f7eeffd-864a-400e-9d6c-84d38677dc67 req-aaea396f-033c-47e1-a317-b800efcde4e4 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:14.634502 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-7f7eeffd-864a-400e-9d6c-84d38677dc67 req-aaea396f-033c-47e1-a317-b800efcde4e4 service nova] Creating event network-changed:16ed99f4-5dbe-4876-92a3-cebcc2442f10 for instance 846b1cfd-b06e-4af7-9429-bb095737877a on hv-cinder-86009 Oct 03 13:41:14.639861 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-7f7eeffd-864a-400e-9d6c-84d38677dc67 req-aaea396f-033c-47e1-a317-b800efcde4e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037825 Oct 03 13:41:14.640491 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 439/880] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:41:54.296178 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:54.296861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:54.299004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:54.299682 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=30 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:54.306843 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:54.307330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:54.307801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:54.308491 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:54.308943 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:54.309395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:54.334179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2e9bdb7c-d2b4-423b-8c93-197f85b2320e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/ips" status: 200 len: 151 microversion: 2.20 time: 0.041894 Oct 03 13:41:54.334759 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 442/881] 10.222.0.58 () {60 vars in 1289 bytes} [Mon Oct 3 13:41:54 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:41:56.671090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:41:56.675789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:41:56.676440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:56.683933 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:56.684418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:56.684860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:56.685580 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:56.686034 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:56.686455 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:56.712410 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lazy-loading 'flavor' on Instance uuid 26f2c44c-5352-4768-99bc-0cb9f51170ed {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:41:56.904220 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-de549682-e47b-458c-a3cf-4f30dbed0c28 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/action" status: 202 len: 0 microversion: 2.20 time: 0.235048 Oct 03 13:41:56.905061 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 440/882] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Oct 3 13:41:56 2022] POST /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:41:56.913202 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:56.914438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:56.921827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:56.922252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:56.922695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:56.923402 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:56.923913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:56.924393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:57.057352 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:57.067009 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:57.068446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:57.069641 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a54072c5-9952-4243-8cd7-5e7a64ff9856 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.160413 Oct 03 13:41:57.070197 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 443/883] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:41:56 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:41:58.096586 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:58.098009 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:58.104373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:58.104863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:58.105297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:58.106016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:58.106473 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:58.106900 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:58.247020 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:58.255430 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:58.256853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:58.258037 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d3063056-8ed4-47ea-b8e8-7b9aaa084b1d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.166451 Oct 03 13:41:58.258592 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 441/884] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:41:58 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:41:59.283993 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:41:59.285167 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:41:59.291850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:59.292391 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:59.292832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:59.293576 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:41:59.294036 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:41:59.294468 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:41:59.425643 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:59.434536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:59.436049 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:41:59.437234 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-bbd09cff-2fa6-4b0e-b72a-6fb079eb76b7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.157237 Oct 03 13:41:59.437825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 444/885] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:41:59 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:00.463498 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:00.464108 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:00.471154 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:00.471646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:00.472083 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:00.472795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:00.473252 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:00.474493 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:00.609559 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:00.618891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:00.620332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:00.621508 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-71848843-6657-4ec8-9abf-28d7ab4de36f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.162113 Oct 03 13:42:00.622079 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 442/886] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:00 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:01.647923 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:01.648706 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:01.655787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:01.656341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:01.656832 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:01.657655 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:01.658211 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:01.658707 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:01.844353 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:01.852115 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:01.853669 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:01.854879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e3a6b7d2-af97-4814-9665-5cdb1068539c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.211130 Oct 03 13:42:01.855451 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 445/887] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:01 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:02.882070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:02.882690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:02.889369 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:02.889897 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:02.890336 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:02.891030 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:02.891488 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:02.891914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:03.025997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:03.034248 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:03.035678 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:03.037357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a0f2ef53-b907-46b8-8b64-55ee14ed9fe2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.159696 Oct 03 13:42:03.037948 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 443/888] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:02 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:04.064109 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:04.064666 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:04.071765 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:04.072251 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:04.072693 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:04.073387 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:04.073880 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:04.074310 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:04.203524 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:04.212012 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:04.213487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:04.214675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-38e08189-e5ab-44be-a704-769b15bb4c13 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.154605 Oct 03 13:42:04.215247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 446/889] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:04 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:05.241467 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:05.242120 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:05.248788 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:05.249275 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:05.250004 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:05.250715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:05.251169 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:05.251597 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:05.389506 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:05.398461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:05.399913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:05.401089 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-00d45683-2225-425f-b152-6319cf65fa74 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.164092 Oct 03 13:42:05.401727 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 444/890] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:05 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:06.426808 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:06.427449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:06.434425 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:06.434917 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:06.435360 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:06.436071 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:06.436532 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:06.436965 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:06.616594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:06.625887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:06.627411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:06.628659 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3293ec09-cb5b-4eab-b9cb-1248dfa4bedd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.205944 Oct 03 13:42:06.633657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 447/891] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:06 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:07.659238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:07.660369 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:07.671809 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:07.672467 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:07.673085 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:07.674011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:07.674938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:07.675357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:07.844263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:07.856964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:07.859370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:07.861646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a6e13b1f-9fab-4e1a-aba6-4bb6d59ece01 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.209462 Oct 03 13:42:07.862703 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 445/892] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:07 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:08.910595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:08.911823 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:08.918710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:08.919210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:08.919659 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:08.920373 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:08.920831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:08.921260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:09.061813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:09.072103 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:09.073784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:09.074989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9137eb68-449a-44d9-b0ea-e81ab162c3bc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.168431 Oct 03 13:42:09.075555 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 448/893] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:08 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:10.102440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:10.103114 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:10.109706 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:10.110195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:10.110633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:10.111338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:10.111795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:10.112222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:10.263222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:10.272989 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:10.274500 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:10.275775 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f14b2804-f8ec-4999-932f-8a786c07e2c2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.178637 Oct 03 13:42:10.276370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 446/894] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:10 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:11.303217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:11.303833 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:11.311260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:11.311755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:11.312196 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:11.312900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:11.313357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:11.313861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:11.453621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:11.463076 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:11.464704 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:11.466052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4698d08f-3ed5-455e-933d-2c65040bda81 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.167238 Oct 03 13:42:11.466728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 449/895] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:11 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:12.494456 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:12.495045 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:12.502178 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:12.502655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:12.503087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:12.503777 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:12.504229 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:12.505257 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:12.649445 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:12.658532 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:12.660056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:12.661787 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f201630f-b39c-4f6a-b8fd-316576ac5e43 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.171299 Oct 03 13:42:12.662537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 447/896] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:12 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:13.688316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:13.688935 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:13.696279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:13.696780 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:13.697226 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:13.697991 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:13.698488 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:13.698985 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:13.854383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:13.863774 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:13.865895 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:13.867247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-aa669ef9-f2fe-4e17-abeb-715103b089d5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.182844 Oct 03 13:42:13.867931 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 450/897] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:13 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:14.893537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:14.894332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:14.901988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:14.902483 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:14.902926 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:14.903636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:14.904094 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:14.904523 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:15.049309 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:15.057960 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:15.059519 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:15.061289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-13d1f909-89e5-485c-af77-d84610193f4c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.171610 Oct 03 13:42:15.062090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 448/898] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:14 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:16.089837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:16.090438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:16.096671 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:16.097158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:16.097632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:16.098376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:16.099410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:16.100068 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:16.237136 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:16.245632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:16.247084 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:16.248256 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-09a029d3-8fb7-4014-a082-41ebea3755dc tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.162638 Oct 03 13:42:16.248813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 451/899] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:16 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:17.275736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:17.276403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:17.283060 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:17.283666 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:17.284111 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:17.284820 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:17.285275 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:17.285726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:17.434797 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:17.444308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:17.446332 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:17.449542 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0f4968ed-5cd1-4c34-a8f8-dfcd768f9a7d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.177853 Oct 03 13:42:17.450267 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 449/900] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:17 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:18.476110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:18.476742 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:18.483605 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:18.484094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:18.484620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:18.485484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:18.486338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:18.486878 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:18.647870 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:18.656726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:18.658224 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:18.659406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5e2281d3-6afa-4ec0-8478-a7c7a77c0a1f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1745 microversion: 2.20 time: 0.187438 Oct 03 13:42:18.659974 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 452/901] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:18 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:19.688284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:19.689068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:19.697408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:19.698023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:19.698543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:19.699244 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:19.699903 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:19.700484 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:19.838597 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:19.847032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:19.848577 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:19.850326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6db0be61-1178-4c5b-868a-b52b984045a4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1745 microversion: 2.20 time: 0.167463 Oct 03 13:42:19.850896 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 450/902] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:19 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:20.876578 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:20.877182 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:20.885389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:20.885917 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:20.886678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:20.887417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:20.888057 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:20.888676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:21.050276 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:21.060319 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:21.062647 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:21.064335 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-94b4c1bf-9826-4c6f-b12f-fff0333da2e6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1740 microversion: 2.20 time: 0.192086 Oct 03 13:42:21.065191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 453/903] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:20 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:22.095103 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:22.095865 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:22.103214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:22.103968 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:22.104589 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:22.105497 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:22.105967 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:22.106399 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:22.297148 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:22.307845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:22.309801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:22.314421 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1a082b51-56d3-4fcf-99fa-d21aefc8a5d6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1740 microversion: 2.20 time: 0.223274 Oct 03 13:42:22.316170 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 451/904] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:22 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:22.350780 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-853dfb21-1e0d-4f0f-b22b-1c618577999a req-c8bcf466-117b-4eab-9686-b892cf167e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f2c44c-5352-4768-99bc-0cb9f51170ed", "name": "network-vif-plugged", "status": "completed", "tag": "6728ff97-c99a-4882-be05-9f48cc629cff"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:42:22.364577 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-853dfb21-1e0d-4f0f-b22b-1c618577999a req-c8bcf466-117b-4eab-9686-b892cf167e3a service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:22.365419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-853dfb21-1e0d-4f0f-b22b-1c618577999a req-c8bcf466-117b-4eab-9686-b892cf167e3a service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:22.365921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-853dfb21-1e0d-4f0f-b22b-1c618577999a req-c8bcf466-117b-4eab-9686-b892cf167e3a service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:22.379624 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-853dfb21-1e0d-4f0f-b22b-1c618577999a req-c8bcf466-117b-4eab-9686-b892cf167e3a service nova] Creating event network-vif-plugged:6728ff97-c99a-4882-be05-9f48cc629cff for instance 26f2c44c-5352-4768-99bc-0cb9f51170ed on hv-cinder-86009 Oct 03 13:42:22.386867 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-853dfb21-1e0d-4f0f-b22b-1c618577999a req-c8bcf466-117b-4eab-9686-b892cf167e3a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040800 Oct 03 13:42:22.387629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 454/905] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:42:23.343781 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:23.344430 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:23.352191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:23.352287 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:23.352807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:23.353552 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:23.354921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:23.354921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:23.516671 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:23.526339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:23.528523 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:23.529579 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-59abe08f-e3c3-4bed-90c8-fbcead504f7a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1740 microversion: 2.20 time: 0.190113 Oct 03 13:42:23.545552 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 452/906] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:23 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:24.557284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:24.558132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:24.560467 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=27 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:24.565806 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:24.566597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:24.567839 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:24.568886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:24.569429 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:24.569981 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:24.573727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=73 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:24.745173 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:24.755647 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:24.757706 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:24.759103 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-96ce4b79-e510-4981-8de0-1739a18faa40 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1740 microversion: 2.20 time: 0.206550 Oct 03 13:42:24.768386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 455/907] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:24 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:25.787628 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:25.789399 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:25.798581 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:25.799418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:25.800076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:25.801022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:25.801710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:25.802160 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:26.149046 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:26.157960 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:26.159616 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:26.161054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ef5c64b4-87cd-4dfa-a682-d3b9af28892a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1740 microversion: 2.20 time: 0.378340 Oct 03 13:42:26.161873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 453/908] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:25 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:27.188312 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:27.189074 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:27.196560 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:27.198994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:27.198994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:27.198994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:27.199581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:27.200324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:27.362121 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:27.371867 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:27.373475 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:27.377280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a045e768-041f-4fbe-8bd0-3d96efe6dfbf tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1740 microversion: 2.20 time: 0.191344 Oct 03 13:42:27.378202 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 456/909] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:27 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:28.405498 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:28.405498 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:28.408938 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=30 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:28.413784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:28.414281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:28.414723 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:28.415427 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:28.415885 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:28.416312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:28.419839 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:28.570556 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:28.579978 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:28.581571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:28.583599 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-569b9077-640a-4a5f-81db-2355c6b0ab0c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1740 microversion: 2.20 time: 0.182455 Oct 03 13:42:28.584564 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 454/910] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:28 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:29.610393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:29.611112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:29.618402 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:29.618947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:29.619385 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:29.620342 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:29.620801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:29.621218 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:29.755216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:29.763526 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:29.764956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:29.766154 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-983a8d2d-0dd1-4454-bd52-c1c12048e98d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1740 microversion: 2.20 time: 0.159858 Oct 03 13:42:29.766716 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 457/911] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:29 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:30.792882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:30.793425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:30.800102 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:30.800589 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:30.801034 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:30.802504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:30.802966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:30.803396 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:30.940878 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:30.949612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:30.951059 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:30.952227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3e6e338d-e793-4b98-8c34-a5df6c18a06e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1722 microversion: 2.20 time: 0.163589 Oct 03 13:42:30.952782 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 455/912] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:30 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:31.979302 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:31.980001 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:31.987244 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:31.987724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:31.988159 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:31.989485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:31.989966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:31.990554 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:32.143507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:32.152470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:32.153996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:32.155187 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-42bf4301-70e3-481b-b968-89eb349016de tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1722 microversion: 2.20 time: 0.180325 Oct 03 13:42:32.155778 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 458/913] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:31 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:33.189413 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:33.190052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:33.197003 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:33.197513 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:33.197955 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:33.198662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:33.199135 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:33.199561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:33.336905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:33.345656 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:33.347110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:33.349060 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7b848848-4e2b-4233-a6c9-7304ab8ed9dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1665 microversion: 2.20 time: 0.163035 Oct 03 13:42:33.349649 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 456/914] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:33 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:33.375275 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b0b1068-7235-4283-8dc6-5a7a50763b4f"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:42:33.378346 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:33.385595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:33.386091 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:33.386539 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:33.387239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:33.387729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:33.388159 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:33.687419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5d22c564-aac9-4d30-bea4-e060d03b78d8 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316979 Oct 03 13:42:33.688306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 459/915] 10.222.0.58 () {62 vars in 1364 bytes} [Mon Oct 3 13:42:33 2022] POST /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 03 13:42:33.827964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:33.828690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:33.837097 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:33.837615 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:33.838175 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:33.838796 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:33.839198 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:33.839667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:34.103698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6b70b904-2f25-428d-a88e-fb6dd111ea88 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/os-volume_attachments/6b0b1068-7235-4283-8dc6-5a7a50763b4f" status: 202 len: 0 microversion: 2.20 time: 0.281925 Oct 03 13:42:34.104308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 457/916] 10.222.0.58 () {60 vars in 1457 bytes} [Mon Oct 3 13:42:33 2022] DELETE /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/os-volume_attachments/6b0b1068-7235-4283-8dc6-5a7a50763b4f => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:42:34.173561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:42:34.174200 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:34.181854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:34.182668 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:34.183195 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:34.183965 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:34.184644 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:34.185209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:34.216718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120742) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 13:42:34.279297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-89aeb73a-9570-453a-a9da-4445d39e6d10 req-09ff8102-f62d-489d-a4f8-1abee72feb27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f2c44c-5352-4768-99bc-0cb9f51170ed", "name": "network-vif-unplugged", "status": "completed", "tag": "6728ff97-c99a-4882-be05-9f48cc629cff"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:42:34.291229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [db374625-fbad-461f-a831-6f48beb085da] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 13:42:34.291545 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-89aeb73a-9570-453a-a9da-4445d39e6d10 req-09ff8102-f62d-489d-a4f8-1abee72feb27 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:34.292264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-89aeb73a-9570-453a-a9da-4445d39e6d10 req-09ff8102-f62d-489d-a4f8-1abee72feb27 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:34.292701 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-89aeb73a-9570-453a-a9da-4445d39e6d10 req-09ff8102-f62d-489d-a4f8-1abee72feb27 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:34.307339 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.compute.server_external_events [req-89aeb73a-9570-453a-a9da-4445d39e6d10 req-09ff8102-f62d-489d-a4f8-1abee72feb27 service nova] Unable to find a host for instance 26f2c44c-5352-4768-99bc-0cb9f51170ed. Dropping event network-vif-unplugged {{(pid=120743) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 03 13:42:34.308438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-89aeb73a-9570-453a-a9da-4445d39e6d10 req-09ff8102-f62d-489d-a4f8-1abee72feb27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033518 Oct 03 13:42:34.309260 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 458/917] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 03 13:42:35.299716 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO oslo.messaging._drivers.impl_rabbit [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [db374625-fbad-461f-a831-6f48beb085da] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 45796. Oct 03 13:42:35.303746 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2b9fe76b-a056-48a0-85bb-20a10c229eb2 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "POST /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/action" status: 202 len: 0 microversion: 2.20 time: 1.134200 Oct 03 13:42:35.304390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 460/918] 10.222.0.58 () {62 vars in 1319 bytes} [Mon Oct 3 13:42:34 2022] POST /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/action => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 03 13:42:35.314314 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:35.315447 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:35.322556 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:35.323045 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:35.323490 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:35.324303 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:35.324762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:35.325193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:35.484083 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:35.493485 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:35.494923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:35.496102 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-66cda67d-405c-4f97-b010-054702b2c5d9 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1673 microversion: 2.20 time: 0.185869 Oct 03 13:42:35.496667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 459/919] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:35 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:36.524726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:36.525339 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:36.531836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:36.532336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:36.532774 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:36.533508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:36.533971 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:36.534400 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:36.845021 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:36.855082 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:36.856119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:36.857316 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1b08b26b-cb0a-421c-ac7e-76dc88f54633 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1675 microversion: 2.20 time: 0.338508 Oct 03 13:42:36.857963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 461/920] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:36 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1675 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:37.884384 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:37.885110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:37.892772 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:37.893254 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:37.893734 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:37.894443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:37.895554 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:37.895993 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:38.073039 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:38.083203 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:38.085597 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:38.086844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f5db004c-61f8-4b98-a6ae-f5cb077c9fe6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.206447 Oct 03 13:42:38.087350 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 460/921] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:37 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:39.114222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:39.115293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:39.122170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:39.122746 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:39.123250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:39.124023 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:39.125228 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:39.126291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:39.328829 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:39.340805 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:39.342482 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:39.344173 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2a66376d-ee01-4c43-a32e-9574f29090dd tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.233950 Oct 03 13:42:39.345005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 462/922] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:39 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:40.391454 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:40.392334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:40.400284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:40.401089 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:40.401577 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:40.402315 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:40.402783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:40.403214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:40.570235 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:40.581286 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:40.583235 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:40.584456 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e9cee321-5160-4ef0-b56e-dd4a6f746b2d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.197232 Oct 03 13:42:40.585045 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 461/923] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:40 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:41.611603 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:41.612180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:41.622608 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:41.623287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:41.624105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:41.631941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:41.632829 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:41.633481 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:41.810688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:41.820888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:41.822786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:41.824515 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ca8c871a-ea9e-4159-a07b-0d05a3310877 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.217093 Oct 03 13:42:41.825484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 463/924] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:41 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:42.852387 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:42.855210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:42.860793 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:42.861372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:42.861790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:42.862472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:42.863068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:42.863392 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:43.045294 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:43.055768 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:43.055768 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:43.058461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1b6e5e97-bb13-4f35-84f9-011cb59645c6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.210669 Oct 03 13:42:43.059078 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 462/925] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:42 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:44.103263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:44.103263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:44.109221 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:44.109747 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:44.110191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:44.110915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:44.111384 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:44.111820 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:44.289263 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:44.298861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:44.300706 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:44.303485 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5b1d7d51-5eb4-431d-ae13-0799254d1996 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.207542 Oct 03 13:42:44.307216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 464/926] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:44 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:45.333138 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:45.334016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:45.341698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:45.342198 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:45.342641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:45.343368 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:45.348902 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:45.349680 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:45.514491 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:45.523003 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:45.524450 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:45.525652 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-54df3391-9cff-4576-ab8e-cc91663d4c10 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.197543 Oct 03 13:42:45.526222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 463/927] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:45 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:46.553399 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:46.554121 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:46.560401 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:46.560889 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:46.561340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:46.562101 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:46.562562 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:46.562995 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:46.693160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:46.701731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:46.703166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:46.704327 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-87c27f48-6d01-40ab-a275-b34513ffca68 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.155220 Oct 03 13:42:46.704891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 465/928] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:46 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:47.730470 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:47.731122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:47.738227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:47.739226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:47.739661 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:47.740372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:47.740838 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:47.741241 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:47.890251 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:47.899217 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:47.900674 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:47.901903 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a99553de-4715-48ed-a1ce-16251d90be53 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.176019 Oct 03 13:42:47.902715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 464/929] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:47 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:48.929642 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:48.930404 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:48.937502 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:48.937992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:48.938430 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:48.939132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:48.939586 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:48.940008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:49.099311 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:49.114456 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:49.117031 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:49.119298 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c473e8ad-3ccb-4186-a869-82afb781220b tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.194103 Oct 03 13:42:49.120367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 466/930] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:48 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:50.220064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:50.220667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:50.227011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:50.227780 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:50.227962 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:50.228741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:50.229193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:50.229648 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:50.428754 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:50.437936 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:50.439529 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:50.440818 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-192e49a4-2088-4157-9a38-9007f219ba2f tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.284381 Oct 03 13:42:50.442638 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 465/931] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:50 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:51.468095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:51.468692 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:51.475499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:51.475993 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:51.476441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:51.477150 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:51.477650 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:51.478086 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:51.626134 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:51.635728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:51.637230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:51.638472 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7ea6d395-30da-4e66-959c-30f9e0d1f4a7 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.174355 Oct 03 13:42:51.639039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 467/932] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:51 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:52.435694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-e5ce5571-8f07-4ecb-a535-5eec3e4efdac req-2dd8c67d-b70b-452e-819a-bfe3376ad5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f2c44c-5352-4768-99bc-0cb9f51170ed", "name": "network-vif-plugged", "status": "completed", "tag": "6728ff97-c99a-4882-be05-9f48cc629cff"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:42:52.450931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e5ce5571-8f07-4ecb-a535-5eec3e4efdac req-2dd8c67d-b70b-452e-819a-bfe3376ad5e1 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:52.451458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e5ce5571-8f07-4ecb-a535-5eec3e4efdac req-2dd8c67d-b70b-452e-819a-bfe3376ad5e1 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:52.451890 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e5ce5571-8f07-4ecb-a535-5eec3e4efdac req-2dd8c67d-b70b-452e-819a-bfe3376ad5e1 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:52.463940 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-e5ce5571-8f07-4ecb-a535-5eec3e4efdac req-2dd8c67d-b70b-452e-819a-bfe3376ad5e1 service nova] Creating event network-vif-plugged:6728ff97-c99a-4882-be05-9f48cc629cff for instance 26f2c44c-5352-4768-99bc-0cb9f51170ed on hv-cinder-86009 Oct 03 13:42:52.470296 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-e5ce5571-8f07-4ecb-a535-5eec3e4efdac req-2dd8c67d-b70b-452e-819a-bfe3376ad5e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099781 Oct 03 13:42:52.470838 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 466/933] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:42:52.669083 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:52.670036 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:52.679019 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:52.679656 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:52.680229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:52.681079 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:52.681643 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:52.682206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:52.685259 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:52.827669 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:52.837000 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:52.838508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:52.839729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-838c2b78-9d33-44c4-b7fd-3e7ed11abfb4 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.175786 Oct 03 13:42:52.840348 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 468/934] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:52 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:42:53.867147 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:53.867846 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:53.874403 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:53.875157 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:53.875596 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:53.876295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:53.876766 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:53.877197 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:54.020360 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:54.035710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:54.037241 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:54.038609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-03bc7793-aca2-4c87-b1f4-9446d64a0bbb tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1731 microversion: 2.20 time: 0.175654 Oct 03 13:42:54.039176 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 467/935] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:53 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:42:55.067317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:42:55.068043 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:42:55.071663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:42:55.075481 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:55.075969 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:55.076408 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:55.077117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:42:55.077626 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:42:55.078058 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:42:55.216711 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:55.225310 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:55.226811 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:42:55.228002 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c9e8e17d-f081-488c-b5b7-a8d8b659f359 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1718 microversion: 2.20 time: 0.165453 Oct 03 13:42:55.228548 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 469/936] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:42:55 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 03 13:43:23.095765 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:23.096408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:23.098975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=27 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:23.099645 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:23.106436 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:23.106928 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:23.107414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:23.108114 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:23.108572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:23.109007 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:23.137681 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:43:23.220944 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4a91c49a-5085-4c30-9bbb-d869e32c4ae2 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "DELETE /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 204 len: 0 microversion: 2.1 time: 0.128853 Oct 03 13:43:23.221592 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 468/937] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:43:23 2022] DELETE /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:43:23.232448 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:23.233225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:23.235378 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:23.236030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=11 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:23.243754 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:23.244444 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:23.245133 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:23.246287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:23.246852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:23.247293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:23.395508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:23.403775 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d8f2e288-2526-43cb-a86f-702378afd0b0 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1577 microversion: 2.1 time: 0.176183 Oct 03 13:43:23.404383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 470/938] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:23 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:24.428630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:24.429951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:24.435988 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:24.436480 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:24.436917 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:24.437656 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:24.438120 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:24.438548 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:24.596750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:24.605783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9609947c-308b-4b20-ac03-900baafe951c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1577 microversion: 2.1 time: 0.181583 Oct 03 13:43:24.606357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 469/939] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:24 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:25.631108 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:25.631835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:25.639308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:25.639815 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:25.640260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:25.640979 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:25.641437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:25.641902 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:25.797776 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:25.813619 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-46f7bfa1-5ffb-4aa3-b2c8-eb5965a11573 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1577 microversion: 2.1 time: 0.186334 Oct 03 13:43:25.814680 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 471/940] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:25 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:26.393211 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-e3312f3d-8821-4245-9c27-fb19176f9f2e req-2dcea752-c046-4d41-a872-693693dcb9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846b1cfd-b06e-4af7-9429-bb095737877a", "name": "network-vif-deleted", "tag": "16ed99f4-5dbe-4876-92a3-cebcc2442f10"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:43:26.410660 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e3312f3d-8821-4245-9c27-fb19176f9f2e req-2dcea752-c046-4d41-a872-693693dcb9f8 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:26.411164 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e3312f3d-8821-4245-9c27-fb19176f9f2e req-2dcea752-c046-4d41-a872-693693dcb9f8 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:26.411599 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-e3312f3d-8821-4245-9c27-fb19176f9f2e req-2dcea752-c046-4d41-a872-693693dcb9f8 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:26.424888 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-e3312f3d-8821-4245-9c27-fb19176f9f2e req-2dcea752-c046-4d41-a872-693693dcb9f8 service nova] Creating event network-vif-deleted:16ed99f4-5dbe-4876-92a3-cebcc2442f10 for instance 846b1cfd-b06e-4af7-9429-bb095737877a on hv-cinder-86009 Oct 03 13:43:26.431734 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-e3312f3d-8821-4245-9c27-fb19176f9f2e req-2dcea752-c046-4d41-a872-693693dcb9f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134511 Oct 03 13:43:26.432357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 470/941] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:43:26.837558 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:26.838202 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:26.845685 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:26.846186 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:26.847545 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:26.847545 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:26.848069 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:26.848389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:26.887367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:26.887864 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:26.888306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:26.888763 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lazy-loading 'fault' on Instance uuid 846b1cfd-b06e-4af7-9429-bb095737877a {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:43:26.933967 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:26.941988 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-770437ce-72b1-459f-b6b4-da257f1b279d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 200 len: 1230 microversion: 2.1 time: 0.108597 Oct 03 13:43:26.942940 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 472/942] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:26 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:43:27.966539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:27.967247 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:27.973410 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:27.973950 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:27.974372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:27.975070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:27.975530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:27.975961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:27.989367 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] HTTP exception thrown: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Request method failure captured: Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a HTTP/1.1 Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuZEvpGYY9KtowMrllQEzXolJsXBgNMRqC0OPz5lO4ORpnSuJCm7Qt3T_z8Pr7ld5ANRgkGeWmPnNvIncSREmYID2C2i2vY9LCIoh9juESCKF2OyxVTmAsHe-fmpRuGPtXtRGd4bjikm4eJAi9KYXOF4K7uDFJMyMPO3QdQiu-R7ZC8 Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:43:27.991023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: f548ccf8c5a14b108aa8b851560139d0 Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:43:27.993238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '846b1cfd-b06e-4af7-9429-bb095737877a'} Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:43:27.994458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:43:27.996032 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:27.997578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Returning 404 to user: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:43:27.997578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6f265785-416b-4187-a47c-8e60f2745ec3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 404 len: 111 microversion: 2.1 time: 0.031375 Oct 03 13:43:27.997578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 471/943] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:27 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:43:28.041238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-113651392", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2088345513", "security_groups": [{"name": "tempest-secgroup-smoke-1836367322"}], "block_device_mapping_v2": [{"uuid": "baeb9336-c0c3-4fe5-8ee2-d6c984dd462e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b3c6d8a-02a1-4730-82ca-c02b5cbef660"}]}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:43:28.167874 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] validate_networks() for [('5b3c6d8a-02a1-4730-82ca-c02b5cbef660', None, None, None, None, None)] {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:43:28.561861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:43:28.562285 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:43:28.562756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:43:28.563163 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:43:28.563625 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:43:28.572478 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:28.572959 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:28.573390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:28.574147 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:28.574598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:28.575026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:28.591947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Getting quotas for project 0e005cbca8874c76bf8ad8f5d336b189. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:43:28.596063 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Getting quotas for user f548ccf8c5a14b108aa8b851560139d0 and project 0e005cbca8874c76bf8ad8f5d336b189. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:43:28.656253 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:43:28.658609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='baeb9336-c0c3-4fe5-8ee2-d6c984dd462e',volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:43:28.796816 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8f84947c-01b0-4c7d-8ba3-d4dbded25dac tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759323 Oct 03 13:43:28.797517 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 473/944] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:43:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:43:28.810179 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-00a3be08-fab1-4454-b8b5-aede30c2c0d4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:28.810799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-00a3be08-fab1-4454-b8b5-aede30c2c0d4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:28.867969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-00a3be08-fab1-4454-b8b5-aede30c2c0d4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:28.875155 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-00a3be08-fab1-4454-b8b5-aede30c2c0d4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1094 microversion: 2.1 time: 0.069457 Oct 03 13:43:28.875732 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 472/945] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:28 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:29.899065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:29.899785 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:29.907156 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:29.907651 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:29.908085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:29.908784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:29.909333 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:29.909842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:29.975100 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:29.984209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-02fdae51-32fb-4c06-ad1f-d30eed33cd38 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1200 microversion: 2.1 time: 0.089773 Oct 03 13:43:29.984788 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 474/946] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:29 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:31.008956 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:31.009713 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:31.017308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:31.017848 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:31.018295 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:31.019022 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:31.019475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:31.019907 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:31.350536 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:31.360422 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-94675baf-7a05-4f24-9dc9-bc89547fcf2d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.356517 Oct 03 13:43:31.361407 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 473/947] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:31 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:43:31.681052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-a83a3192-7db8-4c19-84bb-4013fe6d00eb req-261810c4-b441-4e52-8b9a-b07ebca90826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d41225-bfea-4694-a0a3-1a585d4e8509", "tag": "630021c2-4dd4-422f-ab2c-4c5771c809e4"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:43:31.691453 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a83a3192-7db8-4c19-84bb-4013fe6d00eb req-261810c4-b441-4e52-8b9a-b07ebca90826 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:31.691925 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a83a3192-7db8-4c19-84bb-4013fe6d00eb req-261810c4-b441-4e52-8b9a-b07ebca90826 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:31.692351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a83a3192-7db8-4c19-84bb-4013fe6d00eb req-261810c4-b441-4e52-8b9a-b07ebca90826 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:31.704888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-a83a3192-7db8-4c19-84bb-4013fe6d00eb req-261810c4-b441-4e52-8b9a-b07ebca90826 service nova] Creating event network-changed:630021c2-4dd4-422f-ab2c-4c5771c809e4 for instance d9d41225-bfea-4694-a0a3-1a585d4e8509 on hv-cinder-86009 Oct 03 13:43:31.711431 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-a83a3192-7db8-4c19-84bb-4013fe6d00eb req-261810c4-b441-4e52-8b9a-b07ebca90826 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034074 Oct 03 13:43:31.712171 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 475/948] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:43:32.384806 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:32.385324 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:32.392061 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:32.392539 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:32.392965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:32.393684 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:32.394132 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:32.394552 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:32.606256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:32.614087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9b87904d-343c-463b-8c37-02aaa80bcc05 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.233712 Oct 03 13:43:32.614665 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 474/949] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:32 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:33.536786 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:33.539255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:33.545948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:33.546442 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:33.546884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:33.547592 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:33.548048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:33.548479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:33.582099 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-be34aa4c-1f92-4921-9330-569e4545475c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050211 Oct 03 13:43:33.582688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 476/950] 10.222.0.58 () {60 vars in 1343 bytes} [Mon Oct 3 13:43:33 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:33.638567 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:33.645755 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:33.651168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:33.651682 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:33.654580 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:33.655131 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:33.655801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:33.656530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:33.656993 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:33.657433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:33.657932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:33.658427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:33.658879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:33.659582 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:33.660048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:33.660478 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:33.688734 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:43:33.780313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e3e2cd36-561f-4ca5-a9c1-291d608f2479 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 204 len: 0 microversion: 2.20 time: 0.133521 Oct 03 13:43:33.781297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 477/951] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Oct 3 13:43:33 2022] DELETE /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 03 13:43:33.790994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:33.791876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:33.798857 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:33.799356 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:33.799810 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:33.800533 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:33.801559 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:33.801559 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:33.815679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:33.824477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9918561f-4318-47d5-985f-685a69724154 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.189916 Oct 03 13:43:33.825087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 475/952] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:33 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:33.954596 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:33.963305 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:33.964742 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:33.965948 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a8fa04e2-2f88-4cf6-99c4-c04be0f1526e tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.179596 Oct 03 13:43:33.966508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 478/953] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:43:33 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:43:34.848455 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:34.849052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:34.856471 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:34.856965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:34.857411 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:34.858142 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:34.858601 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:34.859031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:34.991523 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:34.992851 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:34.999924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:35.000419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:35.000865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:35.001612 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:35.002077 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:35.002505 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:35.012571 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:35.025729 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5e43777d-bd4a-4a48-a61a-7330e89a3b91 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.180812 Oct 03 13:43:35.026810 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 476/954] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:34 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:35.146039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:35.155376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:35.156852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:35.158136 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d1474cae-2591-41a8-8139-b51636bd4b35 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1724 microversion: 2.20 time: 0.170583 Oct 03 13:43:35.159850 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 479/955] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:43:34 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:43:36.050207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:36.050778 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:36.057592 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:36.058094 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:36.058537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:36.059242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:36.059709 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:36.060135 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:36.191238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:36.191839 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:36.199178 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:36.199587 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:36.200020 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:36.200711 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:36.201161 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:36.201614 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:36.269588 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:36.282443 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:36.284055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '21fde7fa2a16426890bdcba2241778ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e019f687769f408d9c3faab0c8693a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:36.285931 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a0f979ae-9c03-4569-bdd5-fdc6336e88f5 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 200 len: 1656 microversion: 2.20 time: 0.098465 Oct 03 13:43:36.298308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 480/956] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:43:36 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 1656 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 03 13:43:36.321784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-135696af-fdca-4ce1-a50c-6229d16d9535 req-4c3dc618-b292-4c71-8919-d966b9fe0c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f2c44c-5352-4768-99bc-0cb9f51170ed", "name": "network-vif-deleted", "tag": "6728ff97-c99a-4882-be05-9f48cc629cff"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:43:36.326141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:36.351763 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-135696af-fdca-4ce1-a50c-6229d16d9535 req-4c3dc618-b292-4c71-8919-d966b9fe0c30 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:36.352847 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-135696af-fdca-4ce1-a50c-6229d16d9535 req-4c3dc618-b292-4c71-8919-d966b9fe0c30 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:36.353293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-135696af-fdca-4ce1-a50c-6229d16d9535 req-4c3dc618-b292-4c71-8919-d966b9fe0c30 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:36.354583 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c034cc49-a96c-40df-a299-3a2f8940ea8c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.301815 Oct 03 13:43:36.356031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 477/957] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:36 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:36.377991 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-135696af-fdca-4ce1-a50c-6229d16d9535 req-4c3dc618-b292-4c71-8919-d966b9fe0c30 service nova] Creating event network-vif-deleted:6728ff97-c99a-4882-be05-9f48cc629cff for instance 26f2c44c-5352-4768-99bc-0cb9f51170ed on hv-cinder-86009 Oct 03 13:43:36.390132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-135696af-fdca-4ce1-a50c-6229d16d9535 req-4c3dc618-b292-4c71-8919-d966b9fe0c30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073039 Oct 03 13:43:36.394052 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 481/958] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:43:37.313093 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:37.313882 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:37.320625 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:37.321349 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:37.322033 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:37.322823 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:37.323289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:37.323712 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:37.339058 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] HTTP exception thrown: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Request method failure captured: Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed HTTP/1.1 Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuWtBn7G_RD_mHziKk5eXso1mooUH3PDvh8qOtj8TuZBexfYr4U_uf4Ffe8IlqlnRrFj5ybxCf_-QdHtSmhsCltUVW_U1GI1NCe7_fbx5LRnHEyJEs2aF7VZMzkt0rCUW7wdrr13hBQlTPnHth5zSktDZmqw2NnjcoUvZuU1ThdMtCA Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:43:37.341236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 21fde7fa2a16426890bdcba2241778ed Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:37.344076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '26f2c44c-5352-4768-99bc-0cb9f51170ed'} Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:43:37.345658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:37.348193 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:37.350084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Returning 404 to user: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:43:37.350084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-659377b9-36e9-40ac-a7b6-6ad44d8e526c tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 404 len: 111 microversion: 2.20 time: 0.033127 Oct 03 13:43:37.350084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 478/959] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:43:37 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:43:37.361242 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-bad3dbb8-a0f5-45ee-95cd-a3dc6c9f141a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '.version_select at 0x7f7c21844af0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:37.381870 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:37.382686 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:37.389553 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:37.390223 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:37.390702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:37.391418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:37.391873 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:37.392301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:37.397311 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-bad3dbb8-a0f5-45ee-95cd-a3dc6c9f141a tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460172710" status: 204 len: 0 microversion: 2.20 time: 0.045792 Oct 03 13:43:37.398185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 482/960] 10.222.0.58 () {60 vars in 1262 bytes} [Mon Oct 3 13:43:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1460172710 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 03 13:43:37.539020 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:37.549694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ea5ac7ab-5b97-4250-8002-e3e8c87680d1 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.172600 Oct 03 13:43:37.550359 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 479/961] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:37 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:38.575079 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:38.575908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:38.582976 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:38.585395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:38.585989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:38.586944 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:38.587714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:38.588250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:38.588681 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:38.606591 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=6 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:38.739062 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:38.748470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d144d17a-c9a9-4b5a-b353-69780c96def4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.177753 Oct 03 13:43:38.749063 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 483/962] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:38 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:43:39.198863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:39.199400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:39.203420 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:39.212482 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:39.213121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:39.213658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:39.214463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:39.214966 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:39.215629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:39.240646 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] HTTP exception thrown: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Request method failure captured: Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: DELETE /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed HTTP/1.1 Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuWtBn7G_RD_mHziKk5eXso1mooUH3PDvh8qOtj8TuZBexfYr4U_uf4Ffe8IlqlnRrFj5ybxCf_-QdHtSmhsCltUVW_U1GI1NCe7_fbx5LRnHEyJEs2aF7VZMzkt0rCUW7wdrr13hBQlTPnHth5zSktDZmqw2NnjcoUvZuU1ThdMtCA Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:43:39.242633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 21fde7fa2a16426890bdcba2241778ed Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.245605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '26f2c44c-5352-4768-99bc-0cb9f51170ed'} Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:43:39.246425 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.247867 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.252868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Returning 404 to user: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:43:39.252868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-205b8684-c7ce-4845-bfe9-a97462c709f6 tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 404 len: 111 microversion: 2.20 time: 0.049502 Oct 03 13:43:39.252868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 480/963] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Oct 3 13:43:39 2022] DELETE /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:43:39.253381 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:39.254084 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 26f2c44c-5352-4768-99bc-0cb9f51170ed] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:39.260258 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:39.260752 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:39.261198 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:39.261928 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:39.262386 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:39.262821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:39.277633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] HTTP exception thrown: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Request method failure captured: Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed HTTP/1.1 Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuWtBn7G_RD_mHziKk5eXso1mooUH3PDvh8qOtj8TuZBexfYr4U_uf4Ffe8IlqlnRrFj5ybxCf_-QdHtSmhsCltUVW_U1GI1NCe7_fbx5LRnHEyJEs2aF7VZMzkt0rCUW7wdrr13hBQlTPnHth5zSktDZmqw2NnjcoUvZuU1ThdMtCA Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:43:39.279325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 21fde7fa2a16426890bdcba2241778ed Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.280992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '26f2c44c-5352-4768-99bc-0cb9f51170ed'} Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:43:39.281932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. Oct 03 13:43:39.283493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:39.284787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Returning 404 to user: Instance 26f2c44c-5352-4768-99bc-0cb9f51170ed could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:43:39.284787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-43c2e678-90e5-46e4-98c9-7d4e9a49336d tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed" status: 404 len: 111 microversion: 2.20 time: 0.031609 Oct 03 13:43:39.284787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 484/964] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:43:39 2022] GET /compute/v2.1/servers/26f2c44c-5352-4768-99bc-0cb9f51170ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:43:39.772511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:39.773174 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:39.780716 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:39.781207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:39.781693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:39.782396 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:39.782858 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:39.783316 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:39.924562 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:39.933546 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bf1bab64-b628-4e88-b752-5b3ebafb5fc8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.165071 Oct 03 13:43:39.934145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 481/965] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:39 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:40.428183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:40.428880 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:40.437070 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:40.437603 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:40.438048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:40.438764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:40.439225 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:40.439660 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:40.456354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] HTTP exception thrown: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Request method failure captured: Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 HTTP/1.1 Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuWtBn7G_RD_mHziKk5eXso1mooUH3PDvh8qOtj8TuZBexfYr4U_uf4Ffe8IlqlnRrFj5ybxCf_-QdHtSmhsCltUVW_U1GI1NCe7_fbx5LRnHEyJEs2aF7VZMzkt0rCUW7wdrr13hBQlTPnHth5zSktDZmqw2NnjcoUvZuU1ThdMtCA Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:43:40.457978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 21fde7fa2a16426890bdcba2241778ed Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.459700 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703'} Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:43:40.460639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.462394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.464781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Returning 404 to user: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:43:40.464781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ad597bd5-1b7a-4807-9633-a3a3c2bc44ab tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 404 len: 111 microversion: 2.20 time: 0.035701 Oct 03 13:43:40.464781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 485/966] 10.222.0.58 () {60 vars in 1280 bytes} [Mon Oct 3 13:43:40 2022] DELETE /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:43:40.471699 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:40.472868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] [instance: 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:40.484421 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:40.485323 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:40.486156 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:40.487098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:40.487638 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:40.488229 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:40.507341 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] HTTP exception thrown: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Request method failure captured: Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 HTTP/1.1 Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuWtBn7G_RD_mHziKk5eXso1mooUH3PDvh8qOtj8TuZBexfYr4U_uf4Ffe8IlqlnRrFj5ybxCf_-QdHtSmhsCltUVW_U1GI1NCe7_fbx5LRnHEyJEs2aF7VZMzkt0rCUW7wdrr13hBQlTPnHth5zSktDZmqw2NnjcoUvZuU1ThdMtCA Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Openstack-Nova-Api-Version: 2.20 Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:43:40.509064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e019f687769f408d9c3faab0c8693a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: e019f687769f408d9c3faab0c8693a9d Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-36320458 Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: 21fde7fa2a16426890bdcba2241778ed Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-36320458-project Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.510784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703'} Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:43:40.511691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. Oct 03 13:43:40.513118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:43:40.514558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] Returning 404 to user: Instance 5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:43:40.514558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f74f1211-fc30-4688-b950-209453db31ae tempest-AttachVolumeShelveTestJSON-36320458 tempest-AttachVolumeShelveTestJSON-36320458-project] 10.222.0.58 "GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703" status: 404 len: 111 microversion: 2.20 time: 0.045944 Oct 03 13:43:40.514558 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 482/967] 10.222.0.58 () {60 vars in 1277 bytes} [Mon Oct 3 13:43:40 2022] GET /compute/v2.1/servers/5bdf1da3-13ed-49ca-a2c9-40c7f6ef0703 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 03 13:43:40.958828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:40.958828 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:40.965002 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:40.965517 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:40.965964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:40.966664 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:40.967184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:40.967610 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:41.117499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:41.128271 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-74b921bb-62da-44fd-bf51-41156c0f8538 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.175469 Oct 03 13:43:41.129120 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 486/968] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:40 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:42.156501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:42.157110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:42.164259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:42.165738 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:42.165738 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:42.166562 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:42.167121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:42.167683 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:42.340390 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:42.349819 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-a198d507-ac9c-429c-9a5d-d96a5e6ef27d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.197265 Oct 03 13:43:42.358427 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 483/969] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:42 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:42.929561 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-a319efb4-f008-460b-9f4c-0dd673411f43 req-53d4d08f-dc92-4aff-afa9-a516dc6a2fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d41225-bfea-4694-a0a3-1a585d4e8509", "name": "network-vif-plugged", "status": "completed", "tag": "630021c2-4dd4-422f-ab2c-4c5771c809e4"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:43:42.960727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a319efb4-f008-460b-9f4c-0dd673411f43 req-53d4d08f-dc92-4aff-afa9-a516dc6a2fde service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:42.962030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a319efb4-f008-460b-9f4c-0dd673411f43 req-53d4d08f-dc92-4aff-afa9-a516dc6a2fde service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:42.963026 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a319efb4-f008-460b-9f4c-0dd673411f43 req-53d4d08f-dc92-4aff-afa9-a516dc6a2fde service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:42.983562 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-a319efb4-f008-460b-9f4c-0dd673411f43 req-53d4d08f-dc92-4aff-afa9-a516dc6a2fde service nova] Creating event network-vif-plugged:630021c2-4dd4-422f-ab2c-4c5771c809e4 for instance d9d41225-bfea-4694-a0a3-1a585d4e8509 on hv-cinder-86009 Oct 03 13:43:42.990912 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-a319efb4-f008-460b-9f4c-0dd673411f43 req-53d4d08f-dc92-4aff-afa9-a516dc6a2fde service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071816 Oct 03 13:43:42.992083 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 487/970] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:43:43.375200 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:43.375826 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:43.382899 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:43.384415 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:43.384859 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:43.385702 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:43.386340 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:43.386808 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:43.827129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:43.834983 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-06108c39-946b-4876-afbf-2fe9c261e34c tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.464080 Oct 03 13:43:43.835567 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 484/971] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:43 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:44.860720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:44.861571 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:44.868938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:44.869751 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:44.870388 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:44.871132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:44.871595 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:44.872032 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:45.029339 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:45.042249 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c8c4cf68-c207-4e32-915e-f8c05f4201a8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1266 microversion: 2.1 time: 0.185364 Oct 03 13:43:45.042840 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 488/972] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:44 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:46.065880 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:46.066644 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:46.074086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:46.074573 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:46.075033 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:46.075689 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:46.076145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:46.076565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:46.229272 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:46.240676 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bcec80ed-d7a6-4cf2-8e2b-9762eb9c6222 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1453 microversion: 2.1 time: 0.178458 Oct 03 13:43:46.241274 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 485/973] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:46 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:46.265636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:43:46.266260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:43:46.272394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:46.272894 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:46.273338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:46.274690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:46.275154 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:46.275584 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:46.295502 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:43:46.456416 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:43:46.466055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5e08da76-595c-4502-92a7-9cb53498d27a tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1453 microversion: 2.1 time: 0.204312 Oct 03 13:43:46.466677 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 489/974] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:43:46 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1453 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:43:48.366103 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-99d0f393-bd38-4844-a852-3aef9993f2a3 req-f1f286a0-c273-4f3c-9b19-325742ecc45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d41225-bfea-4694-a0a3-1a585d4e8509", "tag": "630021c2-4dd4-422f-ab2c-4c5771c809e4"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:43:48.375891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-99d0f393-bd38-4844-a852-3aef9993f2a3 req-f1f286a0-c273-4f3c-9b19-325742ecc45e service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:43:48.376365 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-99d0f393-bd38-4844-a852-3aef9993f2a3 req-f1f286a0-c273-4f3c-9b19-325742ecc45e service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:43:48.376792 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-99d0f393-bd38-4844-a852-3aef9993f2a3 req-f1f286a0-c273-4f3c-9b19-325742ecc45e service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:43:48.388408 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-99d0f393-bd38-4844-a852-3aef9993f2a3 req-f1f286a0-c273-4f3c-9b19-325742ecc45e service nova] Creating event network-changed:630021c2-4dd4-422f-ab2c-4c5771c809e4 for instance d9d41225-bfea-4694-a0a3-1a585d4e8509 on hv-cinder-86009 Oct 03 13:43:48.394932 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-99d0f393-bd38-4844-a852-3aef9993f2a3 req-f1f286a0-c273-4f3c-9b19-325742ecc45e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161384 Oct 03 13:43:48.395549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 486/975] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:45:10.647438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:10.648188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:10.653380 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-824179564", "imageRef": "56c55eb4-2e6b-45f1-996f-4d41aa09f4f5", "flavorRef": "452"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:45:10.706317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] validate_networks() for None {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:45:10.982821 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:45:10.983291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:45:10.983879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:45:10.984284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:45:10.984795 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:45:10.994417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:10.994915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:10.995350 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:10.996088 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:10.996546 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:10.996981 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:11.014581 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Getting quotas for project 7bd22634160a4ad38a7e57b11bd0c2db. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:45:11.018574 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Getting quotas for user a8c5959bcd8a4909b94e7253676a5eac and project 7bd22634160a4ad38a7e57b11bd0c2db. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:45:11.030355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:45:11.032653 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56c55eb4-2e6b-45f1-996f-4d41aa09f4f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:45:11.078264 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c520686d-15f0-43f6-9520-a954427d9221 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.432430 Oct 03 13:45:11.078924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 490/976] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:45:11.089883 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:11.090745 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:11.092279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 13:45:11.092703 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Mon Oct 3 13:45:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 (ip 10.222.0.58) !!! Oct 03 13:45:11.094340 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 03 13:45:11.094468 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Mon Oct 3 13:45:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 (ip 10.222.0.58) !!! Oct 03 13:45:11.099161 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-893fdfb0-482d-4929-a073-04fe805f23c7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:11.100091 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-893fdfb0-482d-4929-a073-04fe805f23c7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:11.165338 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-893fdfb0-482d-4929-a073-04fe805f23c7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:11.172288 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-893fdfb0-482d-4929-a073-04fe805f23c7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1214 microversion: 2.1 time: 0.084696 Oct 03 13:45:11.172849 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 487/977] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:11 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:45:12.195884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-35fd54c2-7b9e-4a44-842f-a6887ae40be8 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:12.196501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-35fd54c2-7b9e-4a44-842f-a6887ae40be8 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:12.249267 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-35fd54c2-7b9e-4a44-842f-a6887ae40be8 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:12.256359 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-35fd54c2-7b9e-4a44-842f-a6887ae40be8 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1214 microversion: 2.1 time: 0.064925 Oct 03 13:45:12.256916 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 491/978] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:12 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:13.279561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b436f8e8-e142-45c4-a8d4-ecd122bf2cab tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:13.280417 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b436f8e8-e142-45c4-a8d4-ecd122bf2cab tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:13.339331 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b436f8e8-e142-45c4-a8d4-ecd122bf2cab tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:13.353821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b436f8e8-e142-45c4-a8d4-ecd122bf2cab tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1214 microversion: 2.1 time: 0.077996 Oct 03 13:45:13.354411 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 488/979] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:13 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:45:14.378885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e4fbeed2-99ea-4538-8c14-477fc4f8bc69 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:14.379906 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e4fbeed2-99ea-4538-8c14-477fc4f8bc69 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:14.435166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e4fbeed2-99ea-4538-8c14-477fc4f8bc69 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:14.442667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e4fbeed2-99ea-4538-8c14-477fc4f8bc69 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1214 microversion: 2.1 time: 0.067904 Oct 03 13:45:14.443268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 492/980] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:14 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:15.465733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:15.466346 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:15.473601 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:15.474084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:15.474521 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:15.475200 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:15.475647 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:15.476065 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:15.538757 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:15.550042 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bd3bb61d-1495-4604-a452-4a09f408a407 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1218 microversion: 2.1 time: 0.088160 Oct 03 13:45:15.550931 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 489/981] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:15 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:16.574135 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:16.574756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:16.581814 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:16.582305 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:16.582778 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:16.583482 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:16.583947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:16.584379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:16.647027 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:16.655281 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-79317e7c-4832-4669-adc4-b59db4106c8e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1272 microversion: 2.1 time: 0.085188 Oct 03 13:45:16.655858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 493/982] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:16 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:17.679580 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:17.680516 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:17.687195 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:17.687675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:17.688108 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:17.688798 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:17.689251 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:17.689698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:17.845514 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-97bcd4d5-5ade-41a1-a0d8-0ff4a5f41577 req-516b4e75-d8a8-4c74-8048-2badc3fc2878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2266762-128b-4743-8de5-7f0ea44deec4", "tag": "ff8e3c3f-d4ed-4339-8692-a951e58c0458"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:45:17.857066 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-97bcd4d5-5ade-41a1-a0d8-0ff4a5f41577 req-516b4e75-d8a8-4c74-8048-2badc3fc2878 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:17.857978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-97bcd4d5-5ade-41a1-a0d8-0ff4a5f41577 req-516b4e75-d8a8-4c74-8048-2badc3fc2878 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:17.858614 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-97bcd4d5-5ade-41a1-a0d8-0ff4a5f41577 req-516b4e75-d8a8-4c74-8048-2badc3fc2878 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:17.870990 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-97bcd4d5-5ade-41a1-a0d8-0ff4a5f41577 req-516b4e75-d8a8-4c74-8048-2badc3fc2878 service nova] Creating event network-changed:ff8e3c3f-d4ed-4339-8692-a951e58c0458 for instance c2266762-128b-4743-8de5-7f0ea44deec4 on hv-cinder-86009 Oct 03 13:45:17.876995 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-97bcd4d5-5ade-41a1-a0d8-0ff4a5f41577 req-516b4e75-d8a8-4c74-8048-2badc3fc2878 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035441 Oct 03 13:45:17.877664 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 494/983] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:45:17.951819 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:17.959845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-85707937-5995-432c-a5fc-c4e0193eda24 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1314 microversion: 2.1 time: 0.284096 Oct 03 13:45:17.960427 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 490/984] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:17 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:18.985127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:18.985856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:18.992132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:18.992628 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:18.993645 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:18.994536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:18.995004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:18.995440 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:19.130709 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:19.139321 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3e092579-8485-44ef-b23a-36792ba3f61f tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1314 microversion: 2.1 time: 0.158844 Oct 03 13:45:19.140190 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 495/985] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:18 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:20.169018 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:20.169585 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:20.176158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:20.176644 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:20.177082 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:20.177807 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:20.178264 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:20.178693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:20.311472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:20.319072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3fd0ca76-6d2c-482f-8939-dd1987f7ec9e tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1314 microversion: 2.1 time: 0.154880 Oct 03 13:45:20.319636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 491/986] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:20 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:21.342344 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:21.342996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:21.345400 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:21.350616 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:21.351097 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:21.351534 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:21.352233 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:21.353282 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:21.353739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:21.483061 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:21.491196 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f69edd81-0a80-4c94-81b4-59f76c4195a7 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1314 microversion: 2.1 time: 0.152865 Oct 03 13:45:21.491782 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 496/987] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:21 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:22.516024 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:22.516643 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:22.523284 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:22.523770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:22.524216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:22.525117 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:22.525733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:22.526169 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:22.662387 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:22.670800 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bd7cd584-db15-4a5b-af30-fbb0e013f7cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1314 microversion: 2.1 time: 0.158621 Oct 03 13:45:22.671377 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 492/988] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:22 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:23.245957 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-79c03668-44c5-4b32-8274-c5d75b385932 req-9bd320ae-160a-4726-b680-23e2c19d2c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2266762-128b-4743-8de5-7f0ea44deec4", "name": "network-vif-plugged", "status": "completed", "tag": "ff8e3c3f-d4ed-4339-8692-a951e58c0458"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:45:23.257220 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-79c03668-44c5-4b32-8274-c5d75b385932 req-9bd320ae-160a-4726-b680-23e2c19d2c7d service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:23.257736 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-79c03668-44c5-4b32-8274-c5d75b385932 req-9bd320ae-160a-4726-b680-23e2c19d2c7d service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:23.258184 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-79c03668-44c5-4b32-8274-c5d75b385932 req-9bd320ae-160a-4726-b680-23e2c19d2c7d service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:23.273685 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-79c03668-44c5-4b32-8274-c5d75b385932 req-9bd320ae-160a-4726-b680-23e2c19d2c7d service nova] Creating event network-vif-plugged:ff8e3c3f-d4ed-4339-8692-a951e58c0458 for instance c2266762-128b-4743-8de5-7f0ea44deec4 on hv-cinder-86009 Oct 03 13:45:23.279779 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-79c03668-44c5-4b32-8274-c5d75b385932 req-9bd320ae-160a-4726-b680-23e2c19d2c7d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038023 Oct 03 13:45:23.280713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 497/989] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:45:23.694036 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:23.694690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:23.697361 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:23.703010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:23.703499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:23.703941 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:23.704637 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:23.705097 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:23.705548 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:23.836852 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:23.845866 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-12e7127f-d3fa-46af-a6e4-68ac63d69db1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1314 microversion: 2.1 time: 0.155854 Oct 03 13:45:23.846451 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 493/990] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:23 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:24.865938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=10 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:24.870718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:24.871424 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:24.878117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:24.878602 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:24.879042 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:24.879732 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:24.880188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:24.880620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:25.017395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:25.026517 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ac147d0e-0ba0-4440-9d0f-284b75e1ae2a tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1314 microversion: 2.1 time: 0.161805 Oct 03 13:45:25.027147 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 498/991] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:24 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:26.050648 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:26.051319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:26.058822 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:26.059312 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:26.059750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:26.060443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:26.060906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:26.061335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:26.191238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:26.199554 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cd892001-dc44-437d-a20d-6150a1b54b26 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1464 microversion: 2.1 time: 0.152700 Oct 03 13:45:26.200173 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 494/992] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:26 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:26.247398 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:26.247934 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:26.254636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:26.255129 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:26.255575 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:26.256275 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:26.256737 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:26.257164 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:26.283095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:45:26.368639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3fdb7f3e-0d63-48d2-bfc4-4f2682db9991 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 204 len: 0 microversion: 2.1 time: 0.124730 Oct 03 13:45:26.369341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 499/993] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:45:26 2022] DELETE /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:45:26.378730 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:26.379356 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:26.385605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:26.386098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:26.386544 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:26.387238 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:26.387697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:26.388127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:26.519030 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:26.527690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5c7b9155-fa0e-42a0-9a30-ca827dc516cd tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1470 microversion: 2.1 time: 0.153684 Oct 03 13:45:26.528268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 495/994] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:26 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:27.553124 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:27.553873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:27.561630 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:27.562129 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:27.562952 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:27.563659 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:27.564123 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:27.564559 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:27.696479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:27.704299 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-138d2c0c-82e8-4302-a5fa-8b33591d61da tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1470 microversion: 2.1 time: 0.155844 Oct 03 13:45:27.704871 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 500/995] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:27 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:28.525574 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-a62acff0-4eb0-414c-bce5-0ad8316a7cd8 req-09d15c61-0ae9-40e7-9e1d-581fdbde2110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2266762-128b-4743-8de5-7f0ea44deec4", "name": "network-vif-deleted", "tag": "ff8e3c3f-d4ed-4339-8692-a951e58c0458"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:45:28.539542 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a62acff0-4eb0-414c-bce5-0ad8316a7cd8 req-09d15c61-0ae9-40e7-9e1d-581fdbde2110 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:28.540691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a62acff0-4eb0-414c-bce5-0ad8316a7cd8 req-09d15c61-0ae9-40e7-9e1d-581fdbde2110 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:28.541631 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a62acff0-4eb0-414c-bce5-0ad8316a7cd8 req-09d15c61-0ae9-40e7-9e1d-581fdbde2110 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:28.556010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-a62acff0-4eb0-414c-bce5-0ad8316a7cd8 req-09d15c61-0ae9-40e7-9e1d-581fdbde2110 service nova] Creating event network-vif-deleted:ff8e3c3f-d4ed-4339-8692-a951e58c0458 for instance c2266762-128b-4743-8de5-7f0ea44deec4 on hv-cinder-86009 Oct 03 13:45:28.562304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-a62acff0-4eb0-414c-bce5-0ad8316a7cd8 req-09d15c61-0ae9-40e7-9e1d-581fdbde2110 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041253 Oct 03 13:45:28.562923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 496/996] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:45:28.731303 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:28.732039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:28.738949 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:28.739445 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:28.739884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:28.740588 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:28.741044 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:28.741489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:28.775294 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:28.775781 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:28.776217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:28.776656 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lazy-loading 'fault' on Instance uuid c2266762-128b-4743-8de5-7f0ea44deec4 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:45:28.817849 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8c5959bcd8a4909b94e7253676a5eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bd22634160a4ad38a7e57b11bd0c2db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:28.826092 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-fb31f683-0526-4d20-ba94-85c99e0e0bd1 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 200 len: 1304 microversion: 2.1 time: 0.100304 Oct 03 13:45:28.826676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 501/997] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:28 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:29.854180 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:29.854879 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] [instance: c2266762-128b-4743-8de5-7f0ea44deec4] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:29.861149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:29.861681 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:29.862121 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:29.862814 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:29.863269 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:29.863701 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:29.877824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] HTTP exception thrown: Instance c2266762-128b-4743-8de5-7f0ea44deec4 could not be found. Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Request method failure captured: Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 HTTP/1.1 Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOudlMMYov2IqPzOnsUS1ivFiUkSOQYjRIUG3pbANB-xicZpfTopuyaMR7IMLbsDGxVqUhydsA7HhVKKNF5molToVLDd1whwuri2Dt59dvQkQtV5s8PYlIlez8l5AGrJBXVV3sNuhkRyusE_QiPZKieVIqmEYtvG7eUsaSV9fZIEAlmU Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 7bd22634160a4ad38a7e57b11bd0c2db Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-VolumesNegativeTest-688727769 Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:45:29.879463 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7bd22634160a4ad38a7e57b11bd0c2db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7bd22634160a4ad38a7e57b11bd0c2db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7bd22634160a4ad38a7e57b11bd0c2db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7bd22634160a4ad38a7e57b11bd0c2db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-VolumesNegativeTest-688727769 Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 7bd22634160a4ad38a7e57b11bd0c2db Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-VolumesNegativeTest-688727769 Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-VolumesNegativeTest-688727769-project Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: a8c5959bcd8a4909b94e7253676a5eac Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-VolumesNegativeTest-688727769-project Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance c2266762-128b-4743-8de5-7f0ea44deec4 could not be found. Oct 03 13:45:29.881268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'c2266762-128b-4743-8de5-7f0ea44deec4'} Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2266762-128b-4743-8de5-7f0ea44deec4 could not be found. Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:45:29.882395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2266762-128b-4743-8de5-7f0ea44deec4 could not be found. Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2266762-128b-4743-8de5-7f0ea44deec4 could not be found. Oct 03 13:45:29.884054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:45:29.885651 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] Returning 404 to user: Instance c2266762-128b-4743-8de5-7f0ea44deec4 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:45:29.885651 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-60e89d74-a74c-4cda-9da1-50ccf55a2c00 tempest-VolumesNegativeTest-688727769 tempest-VolumesNegativeTest-688727769-project] 10.222.0.58 "GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4" status: 404 len: 111 microversion: 2.1 time: 0.031464 Oct 03 13:45:29.885651 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 497/998] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:29 2022] GET /compute/v2.1/servers/c2266762-128b-4743-8de5-7f0ea44deec4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:45:48.739437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-754876294", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2088345513", "security_groups": [{"name": "tempest-secgroup-smoke-1836367322"}], "block_device_mapping_v2": [{"uuid": "1eba4443-b45d-42d4-830a-5ee659eb8183", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5b3c6d8a-02a1-4730-82ca-c02b5cbef660"}]}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:45:48.767750 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:48.768407 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:49.061880 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] validate_networks() for [('5b3c6d8a-02a1-4730-82ca-c02b5cbef660', None, None, None, None, None)] {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:45:49.647974 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:45:49.648406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:45:49.648895 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:45:49.649311 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:45:49.649755 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:45:49.658693 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:49.659188 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:49.659632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:49.662569 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:49.663083 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:49.663531 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:49.681710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Getting quotas for project 0e005cbca8874c76bf8ad8f5d336b189. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:45:49.691197 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Getting quotas for user f548ccf8c5a14b108aa8b851560139d0 and project 0e005cbca8874c76bf8ad8f5d336b189. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:45:49.774297 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:45:49.776462 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1eba4443-b45d-42d4-830a-5ee659eb8183',volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:45:49.972523 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-dbff7406-3ca9-4553-838e-8e269f72374d tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.237221 Oct 03 13:45:49.973200 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 502/999] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:45:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:45:49.985051 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c24f00f4-54e3-4e23-95ec-0fe2f43c8d1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:49.985824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c24f00f4-54e3-4e23-95ec-0fe2f43c8d1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:49.988965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=26 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:49.989658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=46 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:45:50.197596 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c24f00f4-54e3-4e23-95ec-0fe2f43c8d1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:50.204455 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c24f00f4-54e3-4e23-95ec-0fe2f43c8d1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1094 microversion: 2.1 time: 0.223850 Oct 03 13:45:50.205044 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 498/1000] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:49 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1094 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:51.235683 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:51.236339 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:51.248517 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:51.249741 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:51.250417 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:51.251399 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:51.252657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:51.253132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:51.330427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:51.349816 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-d27aeca3-5cbc-44f1-b4b8-f32e8d6db24b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1136 microversion: 2.1 time: 0.124919 Oct 03 13:45:51.351403 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 503/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:51 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1136 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:45:52.377385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:52.377964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:52.388334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:52.388833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:52.390105 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:52.395636 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:52.396389 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:52.397001 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:52.483476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:52.492171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-54191db7-3ed0-4e2d-89a1-a5e63ac5270e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1210 microversion: 2.1 time: 0.119990 Oct 03 13:45:52.493348 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 499/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:52 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:53.523499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:53.524861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:53.533068 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:53.535919 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:53.536748 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:53.538105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:53.539250 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:53.540460 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:53.684084 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-7e12ed23-20a5-4299-8ddb-7ca70002b440 req-30fe8a81-9f2e-475c-ae33-8c67b55ccad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9490f8f0-a79a-44a6-97fe-5a06b851a733", "tag": "25791bff-ae48-4944-884e-9dd7145ea3b9"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:45:53.712278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7e12ed23-20a5-4299-8ddb-7ca70002b440 req-30fe8a81-9f2e-475c-ae33-8c67b55ccad7 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:53.713328 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7e12ed23-20a5-4299-8ddb-7ca70002b440 req-30fe8a81-9f2e-475c-ae33-8c67b55ccad7 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:53.714058 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-7e12ed23-20a5-4299-8ddb-7ca70002b440 req-30fe8a81-9f2e-475c-ae33-8c67b55ccad7 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:53.732204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-7e12ed23-20a5-4299-8ddb-7ca70002b440 req-30fe8a81-9f2e-475c-ae33-8c67b55ccad7 service nova] Creating event network-changed:25791bff-ae48-4944-884e-9dd7145ea3b9 for instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 on hv-cinder-86009 Oct 03 13:45:53.738748 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:53.748058 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-db8fb7c0-e7f5-4b41-8e5f-9cf7b5935218 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.228847 Oct 03 13:45:53.752402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-7e12ed23-20a5-4299-8ddb-7ca70002b440 req-30fe8a81-9f2e-475c-ae33-8c67b55ccad7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075134 Oct 03 13:45:53.753619 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 504/1003] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:53 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:53.755277 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 500/1004] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:45:54.777925 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:54.779088 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:54.787928 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:54.788427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:54.788863 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:54.789646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:54.790112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:54.790542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:54.983378 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:54.993070 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c8f99fb8-7b35-49b2-8d24-b68ce4b9eb1b tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.219189 Oct 03 13:45:55.006501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 505/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:54 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:55.531299 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e71e48cc-0301-40e6-95ba-3d840555c89f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Action: 'create', calling method: .version_select at 0x7f7c217bea60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-637017543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8CxGDdvHQLcv6E50Z8RJKNO9jnPYMZOh1jRM0wi+b1iI/kraOmFX/zqExCv1ygK7yEaFYxr/R16UqI/MU7aED10XAdQE2pFgCUbL3CrRo0brQng9GJvcA/GNmWoDEsqw=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:45:55.548857 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-e71e48cc-0301-40e6-95ba-3d840555c89f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Getting quotas for project e8b666774ba8449f90cf329b90725fe4. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:45:55.552831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-e71e48cc-0301-40e6-95ba-3d840555c89f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Getting quotas for user 24f16ea7c1d740ac8de5a4a19b165350 and project e8b666774ba8449f90cf329b90725fe4. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:45:55.579066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e71e48cc-0301-40e6-95ba-3d840555c89f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052852 Oct 03 13:45:55.579717 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 501/1006] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:45:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:45:55.631918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-709312972", "imageRef": "3dce818c-d508-4424-a31f-872016af0f22", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-637017543", "networks": [{"uuid": "aaceeb30-8226-4211-b394-e89b17ce4e38"}]}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:45:55.685596 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] validate_networks() for [('aaceeb30-8226-4211-b394-e89b17ce4e38', None, None, None, None, None)] {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:45:56.023188 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:56.023929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:56.030565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:56.031054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:56.031487 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:56.032176 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:56.032630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:56.033055 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:56.055433 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:45:56.055941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:45:56.056318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:45:56.056728 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:45:56.057140 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:45:56.066315 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:56.066800 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:56.067241 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:56.067972 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:56.068429 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:56.068856 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:56.086285 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Getting quotas for project e8b666774ba8449f90cf329b90725fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:45:56.090185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Getting quotas for user 24f16ea7c1d740ac8de5a4a19b165350 and project e8b666774ba8449f90cf329b90725fe4. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:45:56.101089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:45:56.103230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dce818c-d508-4424-a31f-872016af0f22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:45:56.154358 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-959cf4c1-156f-4fd0-8fab-f65175f0d69f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526279 Oct 03 13:45:56.155347 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 506/1007] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:45:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:45:56.166408 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-8ee90784-0c48-4a68-809e-d6221f7b08b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:56.167180 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-8ee90784-0c48-4a68-809e-d6221f7b08b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:56.177495 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:56.185476 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-77e5b94f-b308-4b3f-b9c1-509c080966b4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.166203 Oct 03 13:45:56.199427 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 502/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:56 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:45:56.229374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-8ee90784-0c48-4a68-809e-d6221f7b08b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:56.237032 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-8ee90784-0c48-4a68-809e-d6221f7b08b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1257 microversion: 2.1 time: 0.074773 Oct 03 13:45:56.237637 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 507/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:56 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:45:57.208491 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:57.209118 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:57.216031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:57.216798 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:57.217355 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:57.218343 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:57.218813 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:57.219244 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:57.260117 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:57.260954 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:57.267997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:57.268612 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:57.269105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:57.269846 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:57.270307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:57.270918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:57.344675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:57.352908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-35135b42-1b89-4d1b-9403-79fbb0c85d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1317 microversion: 2.1 time: 0.096617 Oct 03 13:45:57.353503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 508/1010] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:57 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:45:57.794324 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:57.810991 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-65c656a9-d22c-48c9-ab80-86dc123f7dc7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.605833 Oct 03 13:45:57.821507 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 503/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:57 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:58.378646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:58.379759 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:58.386382 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:58.386878 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:58.387402 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:58.388110 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:58.388568 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:58.388996 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:58.571231 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:58.588129 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-444b3620-e9b3-45a4-9da5-87e0a931efd7 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.214501 Oct 03 13:45:58.605493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 509/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:58 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:45:58.851477 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:58.852088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:58.858736 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:58.859211 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:58.859638 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:58.860318 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:58.860767 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:58.861184 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:58.991158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:58.998971 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c0fe206d-462e-4335-9695-30ed22be5e61 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.151338 Oct 03 13:45:58.999798 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 504/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:58 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:45:59.620275 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:45:59.620902 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:45:59.628239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:59.628729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:59.629385 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:59.631661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:45:59.632127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:45:59.632569 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:45:59.767230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:45:59.776620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6cdee2e5-535f-4440-8340-e26e0d29784f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.160184 Oct 03 13:45:59.787540 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 510/1014] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:45:59 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:00.022517 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:00.023167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:00.030122 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:00.030609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:00.031051 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:00.031743 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:00.032201 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:00.032629 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:00.182517 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:00.190993 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-371b2616-3cb2-4d9b-87f6-f074b12004ca tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.172351 Oct 03 13:46:00.192069 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 505/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:00 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:00.801046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:00.801612 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:00.809158 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:00.810175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:00.810809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:00.811683 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:00.812345 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:00.812915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:00.956183 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:00.963891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0a714f20-eba6-490f-85cf-f8b6caa88d38 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.167041 Oct 03 13:46:00.964452 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 511/1016] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:00 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:01.215191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:01.216404 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:01.223837 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:01.224699 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:01.225141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:01.225913 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:01.226545 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:01.226972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:01.370519 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:01.379137 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2d74da52-4349-4dee-8e1b-c0d57a900936 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.167907 Oct 03 13:46:01.379697 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 506/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:01 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:01.989034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:01.989740 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:02.009187 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:02.009712 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:02.010163 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:02.010879 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:02.011338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:02.011766 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:02.159541 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:02.167351 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-32aaf5fd-a236-41c5-b6a4-966d9ef51fbc tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.183391 Oct 03 13:46:02.167918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 512/1018] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:01 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:02.403449 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:02.404469 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:02.411449 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:02.411937 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:02.412372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:02.413089 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:02.413537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:02.413959 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:02.548961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:02.556744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-37b466e4-bac6-445c-9fd3-4a449408e8e3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.157702 Oct 03 13:46:02.557308 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 507/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:02 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:03.191550 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:03.192322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:03.198798 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:03.199277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:03.200354 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:03.201199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:03.201685 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:03.202105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:03.342136 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:03.350405 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e5a2432d-a91a-4711-a207-0ac5a6b2192a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.162834 Oct 03 13:46:03.351083 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 513/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:03 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:46:03.580043 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:03.580633 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:03.587712 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:03.588099 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:03.588535 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:03.589326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:03.589824 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:03.590267 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:03.750654 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:03.759485 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cbb42f3a-87e1-4c48-8d20-143f93ce2773 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.183536 Oct 03 13:46:03.760680 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 508/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:03 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:04.374987 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:04.376313 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:04.383331 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:04.384131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:04.384766 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:04.385697 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:04.386341 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:04.386989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:04.532896 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:04.540837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f7765f83-6798-4f31-a775-90d597da9902 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.170111 Oct 03 13:46:04.541410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 514/1022] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:04 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:04.783259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:04.783884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:04.790856 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:04.791682 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:04.792399 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:04.793441 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:04.794627 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:04.795279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:04.943731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:04.951561 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cd48b3d4-3c7f-47bd-a9bc-7522b904bfb4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.172195 Oct 03 13:46:04.952129 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 509/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:04 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:05.568309 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:05.570304 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:05.579847 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:05.580642 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:05.581409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:05.582514 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:05.583176 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:05.583742 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:05.737993 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:05.752679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3ae36779-70b4-41ea-9b6c-da80a61b4023 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.187188 Oct 03 13:46:05.752679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 515/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:05 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:05.976638 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:05.977536 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:05.979918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=6 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:46:05.988301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:05.988795 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:05.989233 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:05.990015 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:05.990635 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:05.991065 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:06.138649 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:06.146625 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4bc56ac5-b7d2-492e-81a9-95705217201f tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.175476 Oct 03 13:46:06.147192 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 510/1025] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:05 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:06.773835 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:06.774503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:06.776174 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:46:06.776866 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=14 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:46:06.783608 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:06.784097 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:06.784544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:06.785248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:06.785729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:06.786165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:06.931138 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:06.939173 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e87ff981-ff5e-4695-8fb9-5948f5a778f6 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.169317 Oct 03 13:46:06.939739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 516/1026] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:06 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:07.172265 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:07.174000 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:07.182310 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:07.182759 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:07.183192 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:07.183892 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:07.184344 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:07.184771 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:07.324533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:07.332747 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-72e80f1c-00f7-49f7-a25f-e85fb8378dd6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.166062 Oct 03 13:46:07.333322 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 511/1027] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:07 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:07.963014 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:07.963631 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:07.971042 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:07.971563 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:07.972010 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:07.972713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:07.973210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:07.973681 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:08.104690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:08.112330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7feaec21-538d-4fae-998a-6a1362855d3c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.153503 Oct 03 13:46:08.112901 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 517/1028] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:07 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:08.355614 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:08.356891 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:08.363472 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:08.363950 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:08.364379 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:08.365056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:08.365534 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:08.365957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:08.569512 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:08.577738 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-21b5407b-3810-42c7-b849-8179d6d6a609 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.225838 Oct 03 13:46:08.578329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 512/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:08 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:09.137359 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:09.138662 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:09.145216 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:09.145730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:09.146168 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:09.146941 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:09.147395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:09.147831 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:09.153681 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-4566cd53-53ab-41e9-bac1-3a9d6d9d4d26 req-be5c1ece-2e37-47ea-a701-760e1677544f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54154ca-a01c-443d-8cf1-eb2456c4c293", "tag": "5b116174-9f9f-4896-9258-7e40935b69b0"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:46:09.170026 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4566cd53-53ab-41e9-bac1-3a9d6d9d4d26 req-be5c1ece-2e37-47ea-a701-760e1677544f service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:09.170511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4566cd53-53ab-41e9-bac1-3a9d6d9d4d26 req-be5c1ece-2e37-47ea-a701-760e1677544f service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:09.170951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4566cd53-53ab-41e9-bac1-3a9d6d9d4d26 req-be5c1ece-2e37-47ea-a701-760e1677544f service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:09.191738 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-4566cd53-53ab-41e9-bac1-3a9d6d9d4d26 req-be5c1ece-2e37-47ea-a701-760e1677544f service nova] Creating event network-changed:5b116174-9f9f-4896-9258-7e40935b69b0 for instance d54154ca-a01c-443d-8cf1-eb2456c4c293 on hv-cinder-86009 Oct 03 13:46:09.197127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-4566cd53-53ab-41e9-bac1-3a9d6d9d4d26 req-be5c1ece-2e37-47ea-a701-760e1677544f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047592 Oct 03 13:46:09.198068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 513/1030] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:46:09.309252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:09.317093 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-c753ac65-9445-480d-9d0c-cd2a6efd2d97 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.183574 Oct 03 13:46:09.317860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 518/1031] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:09 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:09.602576 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:09.603269 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:09.610306 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:09.610715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:09.611148 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:09.611841 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:09.612286 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:09.612708 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:09.745578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:09.754422 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fdb41d8e-563d-4915-8e56-a415c71a5553 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.156632 Oct 03 13:46:09.754998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 514/1032] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:09 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:10.339757 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:10.340367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:10.347572 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:10.348054 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:10.348484 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:10.349176 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:10.349653 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:10.350085 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:10.477279 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:10.485924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a472ab1b-5caa-4740-a543-bdaa6c22e723 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.149982 Oct 03 13:46:10.486512 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 519/1033] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:10 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:10.779525 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:10.780152 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:10.786482 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:10.786969 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:10.787400 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:10.788117 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:10.788569 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:10.788992 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:11.010380 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:11.018281 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1d3e4ee9-0370-4c17-bd60-4b6f616275c4 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.243335 Oct 03 13:46:11.018869 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 515/1034] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:10 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:11.509294 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:11.509915 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:11.517046 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:11.517573 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:11.518051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:11.518717 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:11.519178 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:11.519610 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:11.654282 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:11.658166 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=100 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:46:11.663337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-67541482-d036-4add-ac47-bf51a4fac44c tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.157900 Oct 03 13:46:11.663904 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 520/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:11 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:12.040934 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:12.041572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:12.048126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:12.048599 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:12.049031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:12.049735 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:12.050186 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:12.050605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:12.185276 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:12.193133 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-431de8b7-0695-4149-b591-ea4e49cb5844 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.156022 Oct 03 13:46:12.193743 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 516/1036] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:12 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:12.686919 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:12.687544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:12.694686 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:12.695200 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:12.695639 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:12.696357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:12.696813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:12.697237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:12.836852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:12.845998 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-74bdbdba-100b-4647-9d99-669443c8af9d tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.162974 Oct 03 13:46:12.846479 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 521/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:12 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:13.217989 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:13.218597 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:13.224951 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:13.225432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:13.225887 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:13.226570 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:13.227017 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:13.227442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:13.356997 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:13.360540 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=100 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:46:13.365707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7b779664-51bc-4fb0-af91-9fce58b303c9 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.152346 Oct 03 13:46:13.366271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 517/1038] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:13 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:13.869972 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:13.870631 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:13.878555 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:13.879048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:13.879496 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:13.880206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:13.880670 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:13.881103 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:14.015145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-a57f3af8-dd7b-4e67-894f-1244f1ec5b11 req-9250476b-7b69-4548-b477-1c37b5e3f039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9490f8f0-a79a-44a6-97fe-5a06b851a733", "name": "network-vif-plugged", "status": "completed", "tag": "25791bff-ae48-4944-884e-9dd7145ea3b9"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:46:14.019287 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:14.025442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a57f3af8-dd7b-4e67-894f-1244f1ec5b11 req-9250476b-7b69-4548-b477-1c37b5e3f039 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:14.025953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a57f3af8-dd7b-4e67-894f-1244f1ec5b11 req-9250476b-7b69-4548-b477-1c37b5e3f039 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:14.026385 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-a57f3af8-dd7b-4e67-894f-1244f1ec5b11 req-9250476b-7b69-4548-b477-1c37b5e3f039 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:14.029664 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-f01cbb0a-4941-494e-b768-8426e14abf08 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.163029 Oct 03 13:46:14.030748 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 522/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:13 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:14.048017 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-a57f3af8-dd7b-4e67-894f-1244f1ec5b11 req-9250476b-7b69-4548-b477-1c37b5e3f039 service nova] Creating event network-vif-plugged:25791bff-ae48-4944-884e-9dd7145ea3b9 for instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 on hv-cinder-86009 Oct 03 13:46:14.053327 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-a57f3af8-dd7b-4e67-894f-1244f1ec5b11 req-9250476b-7b69-4548-b477-1c37b5e3f039 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043385 Oct 03 13:46:14.054320 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 518/1040] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:46:14.390337 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:14.390963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:14.396978 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:14.397489 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:14.397942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:14.398646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:14.399111 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:14.399544 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:14.539563 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:14.548008 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-1b0db812-73bb-43d2-a26d-5ad0747c9bec tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1266 microversion: 2.1 time: 0.162466 Oct 03 13:46:14.548574 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 523/1041] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:14 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:15.055560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:15.056263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:15.063226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:15.063715 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:15.064157 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:15.064855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:15.065314 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:15.065774 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:15.201809 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:15.209438 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b0392cf5-d070-467f-93cb-cdf91459579f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.158414 Oct 03 13:46:15.210027 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 519/1042] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:15 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:46:15.571349 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:15.571966 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:15.578298 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:15.578787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:15.579229 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:15.579921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:15.580394 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:15.580802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:15.710882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:15.719684 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-270c4951-6a87-42e7-8600-757249c0b0c6 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1453 microversion: 2.1 time: 0.152503 Oct 03 13:46:15.720252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 524/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:15 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:15.742347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:15.743140 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:15.750526 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:15.751088 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:15.751545 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:15.752275 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:15.752762 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:15.753198 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:15.892198 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:15.900668 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1a9157eb-e00e-4080-ac15-12f77d73a868 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1453 microversion: 2.1 time: 0.162177 Oct 03 13:46:15.901501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 520/1044] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:15 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:16.069466 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-edd0cc87-2106-41e4-bfa0-7d9f0df23e31 req-e5ce049f-d890-4b01-b1c8-b0d1f54447e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54154ca-a01c-443d-8cf1-eb2456c4c293", "name": "network-vif-plugged", "status": "completed", "tag": "5b116174-9f9f-4896-9258-7e40935b69b0"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:46:16.079788 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-edd0cc87-2106-41e4-bfa0-7d9f0df23e31 req-e5ce049f-d890-4b01-b1c8-b0d1f54447e9 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:16.080277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-edd0cc87-2106-41e4-bfa0-7d9f0df23e31 req-e5ce049f-d890-4b01-b1c8-b0d1f54447e9 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:16.080714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-edd0cc87-2106-41e4-bfa0-7d9f0df23e31 req-e5ce049f-d890-4b01-b1c8-b0d1f54447e9 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:16.095208 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-edd0cc87-2106-41e4-bfa0-7d9f0df23e31 req-e5ce049f-d890-4b01-b1c8-b0d1f54447e9 service nova] Creating event network-vif-plugged:5b116174-9f9f-4896-9258-7e40935b69b0 for instance d54154ca-a01c-443d-8cf1-eb2456c4c293 on hv-cinder-86009 Oct 03 13:46:16.100567 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-edd0cc87-2106-41e4-bfa0-7d9f0df23e31 req-e5ce049f-d890-4b01-b1c8-b0d1f54447e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034922 Oct 03 13:46:16.101865 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 525/1045] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:46:16.233431 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:16.234240 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:16.241345 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:16.241860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:16.242294 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:16.243347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:16.243847 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:16.244277 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:16.536368 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:16.545364 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bd737801-ac0b-46da-8ebf-76c3725a2961 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.316852 Oct 03 13:46:16.546183 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 521/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:16 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:17.568992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:17.569727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:17.577820 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:17.578246 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:17.578693 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:17.579535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:17.580004 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:17.580477 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:17.718127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:17.726094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5067e280-8b3f-4799-835d-e2d14bbc06cb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1357 microversion: 2.1 time: 0.161463 Oct 03 13:46:17.726605 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 526/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:17 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:17.797236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-aa6a96f6-7769-4e8b-8767-59722e65b9a9 req-8bda0df9-c9f1-49f8-ad17-6e464db75aea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9490f8f0-a79a-44a6-97fe-5a06b851a733", "tag": "25791bff-ae48-4944-884e-9dd7145ea3b9"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:46:17.807183 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-aa6a96f6-7769-4e8b-8767-59722e65b9a9 req-8bda0df9-c9f1-49f8-ad17-6e464db75aea service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:17.807669 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-aa6a96f6-7769-4e8b-8767-59722e65b9a9 req-8bda0df9-c9f1-49f8-ad17-6e464db75aea service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:17.808104 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-aa6a96f6-7769-4e8b-8767-59722e65b9a9 req-8bda0df9-c9f1-49f8-ad17-6e464db75aea service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:17.819320 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-aa6a96f6-7769-4e8b-8767-59722e65b9a9 req-8bda0df9-c9f1-49f8-ad17-6e464db75aea service nova] Creating event network-changed:25791bff-ae48-4944-884e-9dd7145ea3b9 for instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 on hv-cinder-86009 Oct 03 13:46:17.824373 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-aa6a96f6-7769-4e8b-8767-59722e65b9a9 req-8bda0df9-c9f1-49f8-ad17-6e464db75aea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030904 Oct 03 13:46:17.825655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 522/1048] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:46:18.751818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:18.753169 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:18.767837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:18.768433 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:18.768942 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:18.769813 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:18.770499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:18.771598 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:18.919947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:18.928514 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-4bc8cbd1-0864-4fb5-ba06-eac10aa0a0a5 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1548 microversion: 2.1 time: 0.182673 Oct 03 13:46:18.929095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 527/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:18 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:18.953352 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:18.954119 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:18.961087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:18.961623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:18.962044 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:18.962751 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:18.963448 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:18.964023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:19.185950 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:19.195245 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fbc7ddc4-8ef8-4235-8f99-b51df7e4e405 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1548 microversion: 2.1 time: 0.246828 Oct 03 13:46:19.196167 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 523/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:18 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1548 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:19.221404 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:19.226247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:19.227290 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Searching by: {'deleted': False, 'project_id': 'e8b666774ba8449f90cf329b90725fe4'} {{(pid=120742) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 03 13:46:19.229199 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:46:19.236148 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:19.236791 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:19.237238 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:19.238006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:19.238469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:19.238903 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:19.332508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.multi_cell_list [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120742) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 03 13:46:19.427729 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-986b4dcb-652e-4a06-a94c-2de149aac552 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210464 Oct 03 13:46:19.428317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 528/1051] 10.222.0.58 () {58 vars in 1125 bytes} [Mon Oct 3 13:46:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:46:19.440957 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:19.441600 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:19.447504 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:19.447980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:19.448412 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:19.449087 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:19.450231 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:19.450621 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:19.579220 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:19.587070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-16368de3-b321-4d06-bd32-8289e037884f tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1548 microversion: 2.1 time: 0.150006 Oct 03 13:46:19.587639 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 524/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:19 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:21.150209 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dc3420e-827f-4b4f-b160-954fadc72625"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:46:21.152570 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:21.159040 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:21.159529 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:21.159976 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:21.160675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:21.161134 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:21.161593 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:21.404796 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e3dee260-9fe2-4dd8-90b5-791a40155413 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "POST /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258358 Oct 03 13:46:21.405695 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 529/1053] 10.222.0.58 () {60 vars in 1323 bytes} [Mon Oct 3 13:46:21 2022] POST /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:46:29.007076 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:29.007716 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:29.009961 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:46:29.016142 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:29.016630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:29.017062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:29.017784 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:29.018236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:29.018658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:29.161723 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:29.170821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f0aceeac-573f-40fb-bcac-49835862822e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1594 microversion: 2.1 time: 0.167753 Oct 03 13:46:29.171410 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 525/1054] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:29 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:30.816523 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:46:30.821702 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-0d9e684b-f8de-4ad6-8587-1c45be59925c req-93d31629-51fe-4950-aa53-6d8887e83908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54154ca-a01c-443d-8cf1-eb2456c4c293", "tag": "5b116174-9f9f-4896-9258-7e40935b69b0"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:46:30.833330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-0d9e684b-f8de-4ad6-8587-1c45be59925c req-93d31629-51fe-4950-aa53-6d8887e83908 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:30.833954 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-0d9e684b-f8de-4ad6-8587-1c45be59925c req-93d31629-51fe-4950-aa53-6d8887e83908 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:30.834466 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-0d9e684b-f8de-4ad6-8587-1c45be59925c req-93d31629-51fe-4950-aa53-6d8887e83908 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:30.869277 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-0d9e684b-f8de-4ad6-8587-1c45be59925c req-93d31629-51fe-4950-aa53-6d8887e83908 service nova] Creating event network-changed:5b116174-9f9f-4896-9258-7e40935b69b0 for instance d54154ca-a01c-443d-8cf1-eb2456c4c293 on hv-cinder-86009 Oct 03 13:46:30.879410 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-0d9e684b-f8de-4ad6-8587-1c45be59925c req-93d31629-51fe-4950-aa53-6d8887e83908 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064247 Oct 03 13:46:30.880022 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 530/1055] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:46:31.848056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-174940241"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:46:31.848850 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:31.855117 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:31.855737 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:31.856259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:31.857068 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:31.857805 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:31.858423 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:31.998606 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.network.security_group_api [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Adding security group ac10298c-46b3-4d86-b0a0-f8365b8afa16 to port 5b116174-9f9f-4896-9258-7e40935b69b0 Oct 03 13:46:32.324189 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-39c71f2e-ab03-4928-aba1-304564edd064 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "POST /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/action" status: 202 len: 0 microversion: 2.1 time: 0.479954 Oct 03 13:46:32.324982 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 526/1056] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:46:31 2022] POST /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:46:32.334716 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:46:32.335503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:46:32.342719 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:32.343272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:32.343962 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:32.344731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:32.345253 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:32.345836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:32.502607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:46:32.511724 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-fb40f1f6-6e10-4649-b2b3-45b7854d782a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1759 microversion: 2.1 time: 0.182087 Oct 03 13:46:32.512311 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 531/1057] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:46:32 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:46:32.896418 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-2922885c-037c-493f-9004-52c05b1694ca req-53d0cc98-5354-4778-a641-244179d031bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54154ca-a01c-443d-8cf1-eb2456c4c293", "tag": "5b116174-9f9f-4896-9258-7e40935b69b0"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:46:32.906564 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-2922885c-037c-493f-9004-52c05b1694ca req-53d0cc98-5354-4778-a641-244179d031bc service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:46:32.907048 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-2922885c-037c-493f-9004-52c05b1694ca req-53d0cc98-5354-4778-a641-244179d031bc service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:46:32.907547 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-2922885c-037c-493f-9004-52c05b1694ca req-53d0cc98-5354-4778-a641-244179d031bc service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:46:32.919895 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-2922885c-037c-493f-9004-52c05b1694ca req-53d0cc98-5354-4778-a641-244179d031bc service nova] Creating event network-changed:5b116174-9f9f-4896-9258-7e40935b69b0 for instance d54154ca-a01c-443d-8cf1-eb2456c4c293 on hv-cinder-86009 Oct 03 13:46:32.925096 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-2922885c-037c-493f-9004-52c05b1694ca req-53d0cc98-5354-4778-a641-244179d031bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032849 Oct 03 13:46:32.925741 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 527/1058] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:47:04.798098 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:47:04.800320 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:04.802970 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=7 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:47:04.803562 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:47:04.804372 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:47:04.804552 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Mon Oct 3 13:47:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/action (ip 10.222.0.58) !!! Oct 03 13:47:04.819470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:04.820003 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:04.820469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:04.821165 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:04.821652 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:04.822083 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:04.895441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-844d8021-bb0d-4343-a952-acd01316504e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "POST /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/action" status: 202 len: 0 microversion: 2.1 time: 0.101655 Oct 03 13:47:04.898994 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 532/1059] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:47:04 2022] POST /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 13:47:04.902067 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=5 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:47:04.902821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=46 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:47:04.908695 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:04.909595 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:04.917116 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:04.917644 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:04.918073 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:04.919210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:04.919856 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:04.920348 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:05.165062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:05.173682 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e8db3473-edd9-4814-b38f-dcc8653da4b8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1751 microversion: 2.1 time: 0.273116 Oct 03 13:47:05.174268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 528/1060] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:04 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1751 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:47:06.197876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:06.198580 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:06.206104 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:06.206371 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:06.206816 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:06.207509 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:06.207963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:06.208392 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:06.353710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:06.362435 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6bf073a0-1e32-4b5c-af8f-61f6dfe77919 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.168779 Oct 03 13:47:06.362990 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 533/1061] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:06 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:07.386428 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:07.387041 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:07.394114 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:07.394592 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:07.395023 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:07.395700 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:07.396145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:07.396562 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:07.540124 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:07.548684 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-bc0a7e3e-4a03-4148-b93e-1202a173a2fa tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.166067 Oct 03 13:47:07.549263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 529/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:07 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:08.573663 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:08.574280 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:08.580750 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:08.581244 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:08.581715 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:08.582416 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:08.582875 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:08.583305 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:08.728284 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:08.737759 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-85bdac3b-a5b1-4a47-aafc-b1a002fe1627 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.167962 Oct 03 13:47:08.738349 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 534/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:08 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:09.762115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:09.762714 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:09.769343 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:09.769860 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:09.770301 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:09.770994 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:09.771450 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:09.771876 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:09.917756 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:09.926016 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7fa8ed16-b784-4e77-86cf-3ffc4c6cd587 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.167789 Oct 03 13:47:09.926590 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 530/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:09 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:47:10.949854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:10.950452 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:10.956855 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:10.957334 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:10.957848 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:10.958536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:10.958989 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:10.959414 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:11.115132 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:11.123853 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-7f57c862-9ec6-401c-9a3b-0be28e52b538 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.177832 Oct 03 13:47:11.124710 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 535/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:10 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:12.149747 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:12.150644 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:12.157251 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:12.158297 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:12.158740 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:12.159448 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:12.159905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:12.160335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:12.300259 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:12.308518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-c6d40e02-1e07-46d5-81cd-b5ea8403ca05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.163993 Oct 03 13:47:12.309086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 531/1066] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:12 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:13.334365 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:13.334986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:13.341423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:13.341938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:13.342383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:13.343081 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:13.343538 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:13.343972 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:13.488772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:13.497480 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-66a9ec71-0481-418c-80ea-247fdb4ad4a4 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.166957 Oct 03 13:47:13.498145 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 536/1067] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:13 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:14.522744 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:14.523392 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:14.529889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:14.530376 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:14.530817 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:14.532150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:14.532783 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:14.533222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:14.673920 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:14.682161 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7201a2a3-a414-44d0-9cc6-568e7ced23af tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.163323 Oct 03 13:47:14.682731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 532/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:14 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:15.706230 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:15.706837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:15.712976 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:15.713457 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:15.713910 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:15.714594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:15.715041 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:15.715470 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:15.858067 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:15.866907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-152e1f45-0f20-4d96-aca7-19cee4b23e34 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.165195 Oct 03 13:47:15.867476 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 537/1069] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:15 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:16.892150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:16.892765 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:16.899417 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:16.899905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:16.900337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:16.901021 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:16.901499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:16.901929 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:17.063758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:17.071967 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9eac8642-c6d2-49e5-aa5c-5dec322efaf3 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.184458 Oct 03 13:47:17.072533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 533/1070] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:16 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:18.097034 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:18.097731 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:18.104143 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:18.104629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:18.105072 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:18.105787 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:18.106247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:18.106678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:18.251648 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:18.260336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-5418e2c8-c767-4e0b-94b8-a4babc291e56 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.167977 Oct 03 13:47:18.260913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 538/1071] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:18 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:19.284821 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:19.285725 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:19.292769 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:19.293252 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:19.293719 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:19.294395 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:19.294844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:19.295263 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:19.439685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:19.447730 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5c4cf16b-4c76-4187-a26c-e361e06f36bb tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.167288 Oct 03 13:47:19.448289 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 534/1072] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:19 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:20.471802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:20.472411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:20.478883 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:20.479367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:20.479806 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:20.480494 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:20.480947 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:20.481377 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:20.624600 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:20.633511 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-50893930-7fd3-44cb-b77b-13523fbaf60e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.165649 Oct 03 13:47:20.634083 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 539/1073] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:20 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:21.657998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:21.658631 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:21.666962 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:21.667450 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:21.667893 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:21.668604 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:21.669072 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:21.669514 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:21.829262 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:21.837731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-cdbec449-ef5f-4a35-9d50-02bccfeefc52 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1756 microversion: 2.1 time: 0.184424 Oct 03 13:47:21.838305 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 535/1074] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:21 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:47:22.862047 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:47:22.862681 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:47:22.869210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:22.869725 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:22.870167 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:22.870858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:47:22.871321 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:47:22.871752 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:47:23.015137 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:47:23.023926 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-816f47b7-cec3-4624-9645-43d44335d1c9 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1759 microversion: 2.1 time: 0.166041 Oct 03 13:47:23.024503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 540/1075] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:47:22 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:01.386799 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-174940241"}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:01.387402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:01.389329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=16 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:01.390293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=48 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:01.396257 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:01.396746 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:01.397182 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:01.397906 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:01.398364 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:01.398789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:01.525940 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.network.security_group_api [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Removing security group ac10298c-46b3-4d86-b0a0-f8365b8afa16 from port 5b116174-9f9f-4896-9258-7e40935b69b0 Oct 03 13:48:01.842645 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-900530f5-b91f-4ee4-906c-95068a43ea79 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "POST /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/action" status: 202 len: 0 microversion: 2.1 time: 0.459936 Oct 03 13:48:01.843260 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 536/1076] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:48:01 2022] POST /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:48:01.848758 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=18 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:01.849720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:01.854330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-834f2755-6966-40d0-b567-37b24cfd50a3 req-c617cf22-8eb9-4ccb-a227-a59343bba24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54154ca-a01c-443d-8cf1-eb2456c4c293", "tag": "5b116174-9f9f-4896-9258-7e40935b69b0"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:01.864293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-834f2755-6966-40d0-b567-37b24cfd50a3 req-c617cf22-8eb9-4ccb-a227-a59343bba24b service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:01.864869 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-834f2755-6966-40d0-b567-37b24cfd50a3 req-c617cf22-8eb9-4ccb-a227-a59343bba24b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:01.865244 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-834f2755-6966-40d0-b567-37b24cfd50a3 req-c617cf22-8eb9-4ccb-a227-a59343bba24b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:01.879359 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-834f2755-6966-40d0-b567-37b24cfd50a3 req-c617cf22-8eb9-4ccb-a227-a59343bba24b service nova] Creating event network-changed:5b116174-9f9f-4896-9258-7e40935b69b0 for instance d54154ca-a01c-443d-8cf1-eb2456c4c293 on hv-cinder-86009 Oct 03 13:48:01.885582 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-834f2755-6966-40d0-b567-37b24cfd50a3 req-c617cf22-8eb9-4ccb-a227-a59343bba24b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037586 Oct 03 13:48:01.887383 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 541/1077] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:48:02.965745 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:02.966288 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:02.968676 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-62288361-ae08-4397-b3f1-f8b695ad98ba req-e77b8435-557f-4783-9c02-22c13d08449b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d54154ca-a01c-443d-8cf1-eb2456c4c293", "tag": "5b116174-9f9f-4896-9258-7e40935b69b0"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:02.972562 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:02.973052 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:02.973515 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:02.974222 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:02.974856 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:02.975461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:02.981054 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-62288361-ae08-4397-b3f1-f8b695ad98ba req-e77b8435-557f-4783-9c02-22c13d08449b service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:02.981633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-62288361-ae08-4397-b3f1-f8b695ad98ba req-e77b8435-557f-4783-9c02-22c13d08449b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:02.982298 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-62288361-ae08-4397-b3f1-f8b695ad98ba req-e77b8435-557f-4783-9c02-22c13d08449b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:02.994836 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-62288361-ae08-4397-b3f1-f8b695ad98ba req-e77b8435-557f-4783-9c02-22c13d08449b service nova] Creating event network-changed:5b116174-9f9f-4896-9258-7e40935b69b0 for instance d54154ca-a01c-443d-8cf1-eb2456c4c293 on hv-cinder-86009 Oct 03 13:48:03.000374 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-62288361-ae08-4397-b3f1-f8b695ad98ba req-e77b8435-557f-4783-9c02-22c13d08449b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036348 Oct 03 13:48:03.001065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 542/1078] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:48:03.068953 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.objects.instance [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lazy-loading 'services' on Instance uuid d54154ca-a01c-443d-8cf1-eb2456c4c293 {{(pid=120743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:48:03.159417 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4a958d2f-5863-4532-b6c0-65f120c27fed tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments/8dc3420e-827f-4b4f-b160-954fadc72625" status: 202 len: 0 microversion: 2.1 time: 0.197943 Oct 03 13:48:03.160419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 537/1079] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:48:02 2022] DELETE /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments/8dc3420e-827f-4b4f-b160-954fadc72625 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 13:48:03.169427 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:03.172726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:03.181340 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:03.182030 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:03.182730 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:03.183718 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:03.184460 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:03.185123 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:03.230641 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a6bc5e6b-e8a4-4750-8b18-42dad80d0cf1 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065510 Oct 03 13:48:03.231609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 543/1080] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:48:03 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:48:04.245479 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:04.247954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:04.255292 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:04.255790 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:04.256232 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:04.256964 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:04.257426 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:04.257965 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:04.288515 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-af403523-a57d-4484-9cf1-c14b80898855 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047859 Oct 03 13:48:04.289171 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 538/1081] 10.222.0.58 () {58 vars in 1302 bytes} [Mon Oct 3 13:48:04 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 03 13:48:04.299876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:04.300409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:04.306714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:04.307192 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:04.307627 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:04.308307 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:04.308754 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:04.309175 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:04.385542 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] HTTP exception thrown: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 is not attached to volume 8dc3420e-827f-4b4f-b160-954fadc72625 Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Request method failure captured: Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments/8dc3420e-827f-4b4f-b160-954fadc72625 HTTP/1.1 Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOueDXdXhES_MFA0hzTwqO3WmeDZQGgdH0YuCEsUcJpDfuY7NJdk4ls_gi9ADPZBcESTgBnGbXTE8MHUmgexI-1sjjmZJlp8m7RhR5dGwuRua4rfL0YXEyOduVzp_WgqEiVx5bTxna6JMkjYTyDWvLYvicNRrAPdsj_DA8U0zehM6Y_M Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: e8b666774ba8449f90cf329b90725fe4 Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-TestMinimumBasicScenario-1409387789 Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:48:04.387891 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8b666774ba8449f90cf329b90725fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8b666774ba8449f90cf329b90725fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e8b666774ba8449f90cf329b90725fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e8b666774ba8449f90cf329b90725fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-TestMinimumBasicScenario-1409387789 Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: e8b666774ba8449f90cf329b90725fe4 Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1409387789 Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-TestMinimumBasicScenario-1409387789-project Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 24f16ea7c1d740ac8de5a4a19b165350 Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-TestMinimumBasicScenario-1409387789-project Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:48:04.394885 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 is not attached to volume 8dc3420e-827f-4b4f-b160-954fadc72625 Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'server_id': 'd54154ca-a01c-443d-8cf1-eb2456c4c293', 'id': '8dc3420e-827f-4b4f-b160-954fadc72625'} Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8dc3420e-827f-4b4f-b160-954fadc72625. Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:48:04.396144 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 is not attached to volume 8dc3420e-827f-4b4f-b160-954fadc72625 Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 is not attached to volume 8dc3420e-827f-4b4f-b160-954fadc72625 Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:04.397882 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Returning 404 to user: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 is not attached to volume 8dc3420e-827f-4b4f-b160-954fadc72625 {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:48:04.399095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-2bc4dd1f-f934-4404-880a-c5996012c79e tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments/8dc3420e-827f-4b4f-b160-954fadc72625" status: 404 len: 154 microversion: 2.1 time: 0.093504 Oct 03 13:48:04.399095 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 544/1082] 10.222.0.58 () {58 vars in 1416 bytes} [Mon Oct 3 13:48:04 2022] DELETE /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293/os-volume_attachments/8dc3420e-827f-4b4f-b160-954fadc72625 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:48:05.532144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:05.532778 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:05.539996 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:05.540490 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:05.540930 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:05.541675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:05.542136 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:05.542569 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:05.567820 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:48:05.643594 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2e61037d-d6ef-405e-94dc-aab8570aaf05 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 204 len: 0 microversion: 2.1 time: 0.114986 Oct 03 13:48:05.644168 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 539/1083] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:48:05 2022] DELETE /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:48:05.652825 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:05.653444 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:05.661104 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:05.661648 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:05.662097 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:05.662816 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:05.663257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:05.663689 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:05.794993 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:05.802772 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3e486fb9-a2a1-461f-8a88-56e069109aac tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1554 microversion: 2.1 time: 0.154135 Oct 03 13:48:05.803330 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 545/1084] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:05 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:06.826554 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:06.827283 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:06.833903 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:06.834388 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:06.834859 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:06.835556 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:06.836013 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:06.836443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:06.966246 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:06.974461 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-1e952718-d0ec-417d-8873-a5b8ca98212a tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1554 microversion: 2.1 time: 0.151765 Oct 03 13:48:06.974644 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 540/1085] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:06 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:07.997624 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:07.998247 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:08.006055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:08.006546 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:08.006983 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:08.007679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:08.008128 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:08.008552 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:08.141963 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f16ea7c1d740ac8de5a4a19b165350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b666774ba8449f90cf329b90725fe4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:08.150451 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ceffa78d-dbc6-4918-b079-953c40879e72 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 200 len: 1554 microversion: 2.1 time: 0.156733 Oct 03 13:48:08.151222 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 546/1086] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:07 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:08.352273 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-3a348774-f24c-4d2f-8cd7-e5105810442e req-50aa6908-b556-470f-a1e6-798f08b2ec0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d54154ca-a01c-443d-8cf1-eb2456c4c293", "name": "network-vif-deleted", "tag": "5b116174-9f9f-4896-9258-7e40935b69b0"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:08.364186 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3a348774-f24c-4d2f-8cd7-e5105810442e req-50aa6908-b556-470f-a1e6-798f08b2ec0b service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:08.364672 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3a348774-f24c-4d2f-8cd7-e5105810442e req-50aa6908-b556-470f-a1e6-798f08b2ec0b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:08.365104 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-3a348774-f24c-4d2f-8cd7-e5105810442e req-50aa6908-b556-470f-a1e6-798f08b2ec0b service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:08.378185 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-3a348774-f24c-4d2f-8cd7-e5105810442e req-50aa6908-b556-470f-a1e6-798f08b2ec0b service nova] Creating event network-vif-deleted:5b116174-9f9f-4896-9258-7e40935b69b0 for instance d54154ca-a01c-443d-8cf1-eb2456c4c293 on hv-cinder-86009 Oct 03 13:48:08.384260 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-3a348774-f24c-4d2f-8cd7-e5105810442e req-50aa6908-b556-470f-a1e6-798f08b2ec0b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Oct 03 13:48:08.384975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 541/1087] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:48:09.174661 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:09.175211 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] [instance: d54154ca-a01c-443d-8cf1-eb2456c4c293] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:09.181701 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:09.182194 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:09.182637 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:09.183336 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:09.183796 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:09.184231 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:09.198347 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] HTTP exception thrown: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 could not be found. Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Request method failure captured: Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 HTTP/1.1 Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOueDXdXhES_MFA0hzTwqO3WmeDZQGgdH0YuCEsUcJpDfuY7NJdk4ls_gi9ADPZBcESTgBnGbXTE8MHUmgexI-1sjjmZJlp8m7RhR5dGwuRua4rfL0YXEyOduVzp_WgqEiVx5bTxna6JMkjYTyDWvLYvicNRrAPdsj_DA8U0zehM6Y_M Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: e8b666774ba8449f90cf329b90725fe4 Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-TestMinimumBasicScenario-1409387789 Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:48:09.199908 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8b666774ba8449f90cf329b90725fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8b666774ba8449f90cf329b90725fe4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e8b666774ba8449f90cf329b90725fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e8b666774ba8449f90cf329b90725fe4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-TestMinimumBasicScenario-1409387789 Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: e8b666774ba8449f90cf329b90725fe4 Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1409387789 Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-TestMinimumBasicScenario-1409387789-project Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 24f16ea7c1d740ac8de5a4a19b165350 Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-TestMinimumBasicScenario-1409387789-project Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 could not be found. Oct 03 13:48:09.201674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': 'd54154ca-a01c-443d-8cf1-eb2456c4c293'} Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 could not be found. Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:48:09.202860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 could not be found. Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 could not be found. Oct 03 13:48:09.204535 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:09.206409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Returning 404 to user: Instance d54154ca-a01c-443d-8cf1-eb2456c4c293 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:48:09.206409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6458f53a-f8cf-4ba5-ba5b-9434e5f57cd8 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293" status: 404 len: 111 microversion: 2.1 time: 0.031173 Oct 03 13:48:09.206409 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 547/1088] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:09 2022] GET /compute/v2.1/servers/d54154ca-a01c-443d-8cf1-eb2456c4c293 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:48:09.210572 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-e1a0ec56-ad69-432e-9e9e-cd6bcb6b8e91 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] Calling method '.version_select at 0x7f7c21a25940>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:09.228611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-e1a0ec56-ad69-432e-9e9e-cd6bcb6b8e91 tempest-TestMinimumBasicScenario-1409387789 tempest-TestMinimumBasicScenario-1409387789-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-637017543" status: 202 len: 0 microversion: 2.1 time: 0.022177 Oct 03 13:48:09.229173 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 542/1089] 10.222.0.58 () {58 vars in 1269 bytes} [Mon Oct 3 13:48:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-637017543 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 03 13:48:11.023379 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:11.024295 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:11.030066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-ce25154e-a17d-4f63-9a8c-bce5a222f7e9 req-3cfbaf47-f1f8-48a4-9015-061c79ba4db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9490f8f0-a79a-44a6-97fe-5a06b851a733", "tag": "25791bff-ae48-4944-884e-9dd7145ea3b9"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:11.031936 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:11.033406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:11.034118 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:11.035187 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:11.035852 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:11.036495 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:11.044623 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ce25154e-a17d-4f63-9a8c-bce5a222f7e9 req-3cfbaf47-f1f8-48a4-9015-061c79ba4db5 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:11.045536 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ce25154e-a17d-4f63-9a8c-bce5a222f7e9 req-3cfbaf47-f1f8-48a4-9015-061c79ba4db5 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:11.046140 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-ce25154e-a17d-4f63-9a8c-bce5a222f7e9 req-3cfbaf47-f1f8-48a4-9015-061c79ba4db5 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:11.059215 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-ce25154e-a17d-4f63-9a8c-bce5a222f7e9 req-3cfbaf47-f1f8-48a4-9015-061c79ba4db5 service nova] Creating event network-changed:25791bff-ae48-4944-884e-9dd7145ea3b9 for instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 on hv-cinder-86009 Oct 03 13:48:11.065777 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:48:11.066329 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-ce25154e-a17d-4f63-9a8c-bce5a222f7e9 req-3cfbaf47-f1f8-48a4-9015-061c79ba4db5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039598 Oct 03 13:48:11.067693 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 543/1090] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:48:11.155810 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e716e3e4-cad1-4dbf-af56-07f046858d04 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 204 len: 0 microversion: 2.1 time: 0.136257 Oct 03 13:48:11.160319 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 548/1091] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:48:11 2022] DELETE /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:48:11.166568 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:11.168138 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:11.174787 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:11.175419 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:11.175935 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:11.176752 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:11.177320 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:11.178006 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:11.386962 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:11.395675 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-58feb109-8af8-4e06-a1b8-d6b18ea399a7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1577 microversion: 2.1 time: 0.233807 Oct 03 13:48:11.410046 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 544/1092] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:11 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:12.420714 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:12.421419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:12.428727 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:12.429219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:12.429691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:12.430393 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:12.430845 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:12.431271 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:12.582406 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:12.592006 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-929c0dc6-a625-40cf-af94-6a59ba48eb72 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1577 microversion: 2.1 time: 0.175385 Oct 03 13:48:12.592873 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 549/1093] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:12 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:13.616612 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:13.617981 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:13.626994 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:13.627853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:13.628616 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:13.630855 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:13.631758 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:13.632524 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:13.884413 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-a79a4579-b91d-45cc-acb3-540b72bab30b req-886cfdf7-f084-4ad2-b399-282393e0ac76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9490f8f0-a79a-44a6-97fe-5a06b851a733", "name": "network-vif-deleted", "tag": "25791bff-ae48-4944-884e-9dd7145ea3b9"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:13.903636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a79a4579-b91d-45cc-acb3-540b72bab30b req-886cfdf7-f084-4ad2-b399-282393e0ac76 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:13.904274 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a79a4579-b91d-45cc-acb3-540b72bab30b req-886cfdf7-f084-4ad2-b399-282393e0ac76 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:13.904801 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-a79a4579-b91d-45cc-acb3-540b72bab30b req-886cfdf7-f084-4ad2-b399-282393e0ac76 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:13.921511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:13.931116 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-de15acc6-a3db-4ac2-b50b-f6a827c3f161 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 200 len: 1459 microversion: 2.1 time: 0.318732 Oct 03 13:48:13.932242 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-a79a4579-b91d-45cc-acb3-540b72bab30b req-886cfdf7-f084-4ad2-b399-282393e0ac76 service nova] Creating event network-vif-deleted:25791bff-ae48-4944-884e-9dd7145ea3b9 for instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 on hv-cinder-86009 Oct 03 13:48:13.935432 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 545/1094] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:13 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 1459 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:13.939771 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-a79a4579-b91d-45cc-acb3-540b72bab30b req-886cfdf7-f084-4ad2-b399-282393e0ac76 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059044 Oct 03 13:48:13.941089 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 550/1095] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:48:14.958030 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:14.958710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 9490f8f0-a79a-44a6-97fe-5a06b851a733] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:14.965350 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:14.966115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:14.966550 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:14.967244 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:14.967734 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:14.968158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:14.982256 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] HTTP exception thrown: Instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 could not be found. Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Request method failure captured: Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 HTTP/1.1 Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuZEvpGYY9KtowMrllQEzXolJsXBgNMRqC0OPz5lO4ORpnSuJCm7Qt3T_z8Pr7ld5ANRgkGeWmPnNvIncSREmYID2C2i2vY9LCIoh9juESCKF2OyxVTmAsHe-fmpRuGPtXtRGd4bjikm4eJAi9KYXOF4K7uDFJMyMPO3QdQiu-R7ZC8 Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:48:14.983921 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: f548ccf8c5a14b108aa8b851560139d0 Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 could not be found. Oct 03 13:48:14.986151 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '9490f8f0-a79a-44a6-97fe-5a06b851a733'} Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 could not be found. Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:48:14.990533 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 could not be found. Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 could not be found. Oct 03 13:48:14.992070 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:14.993896 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Returning 404 to user: Instance 9490f8f0-a79a-44a6-97fe-5a06b851a733 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:48:14.993896 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-0f715550-5931-4f2d-bafb-2b670fb5b196 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733" status: 404 len: 111 microversion: 2.1 time: 0.031375 Oct 03 13:48:14.993896 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 546/1096] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:14 2022] GET /compute/v2.1/servers/9490f8f0-a79a-44a6-97fe-5a06b851a733 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:48:18.652086 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-4ec46dc4-c977-454e-a769-eac9473c6800 req-4ccab85b-7472-45fa-ad0a-6f1e9278a4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d41225-bfea-4694-a0a3-1a585d4e8509", "tag": "630021c2-4dd4-422f-ab2c-4c5771c809e4"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:18.652868 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:18.653500 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:18.661726 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:18.662329 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:18.663101 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:18.663887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:18.664699 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:18.666007 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:18.675123 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4ec46dc4-c977-454e-a769-eac9473c6800 req-4ccab85b-7472-45fa-ad0a-6f1e9278a4f9 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:18.675883 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4ec46dc4-c977-454e-a769-eac9473c6800 req-4ccab85b-7472-45fa-ad0a-6f1e9278a4f9 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:18.676436 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-4ec46dc4-c977-454e-a769-eac9473c6800 req-4ccab85b-7472-45fa-ad0a-6f1e9278a4f9 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:18.689889 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-4ec46dc4-c977-454e-a769-eac9473c6800 req-4ccab85b-7472-45fa-ad0a-6f1e9278a4f9 service nova] Creating event network-changed:630021c2-4dd4-422f-ab2c-4c5771c809e4 for instance d9d41225-bfea-4694-a0a3-1a585d4e8509 on hv-cinder-86009 Oct 03 13:48:18.695367 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-4ec46dc4-c977-454e-a769-eac9473c6800 req-4ccab85b-7472-45fa-ad0a-6f1e9278a4f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046834 Oct 03 13:48:18.696707 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 547/1097] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:48:18.702666 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Going to try to terminate instance {{(pid=120742) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:48:18.834223 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9b4f53fa-2a7b-4159-84c2-f665fb191b67 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 204 len: 0 microversion: 2.1 time: 0.186590 Oct 03 13:48:18.834888 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 551/1098] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:48:18 2022] DELETE /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:48:18.848382 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:18.850409 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:18.858611 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:18.860156 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:18.862475 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:18.863731 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:18.868582 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:18.870109 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:19.042059 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:19.052451 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5552a421-72b4-4e03-b530-be9f748c2dde tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1578 microversion: 2.1 time: 0.211880 Oct 03 13:48:19.057497 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 548/1099] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:18 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1578 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:20.083629 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:20.085997 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:20.095937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:20.096860 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:20.097707 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:20.098533 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:20.099062 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:20.099503 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:20.301102 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:20.309011 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-69d234ce-8f84-47fe-8a6e-2558b2338d4e tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1578 microversion: 2.1 time: 0.230879 Oct 03 13:48:20.315577 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 552/1100] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:20 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1578 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:21.219667 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-b3c932df-6bd0-44d7-afc4-9ebfdcb8741f req-07f89c02-c746-4820-b130-4f5b51cbff5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d41225-bfea-4694-a0a3-1a585d4e8509", "name": "network-vif-deleted", "tag": "630021c2-4dd4-422f-ab2c-4c5771c809e4"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:21.230465 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b3c932df-6bd0-44d7-afc4-9ebfdcb8741f req-07f89c02-c746-4820-b130-4f5b51cbff5c service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:21.233095 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b3c932df-6bd0-44d7-afc4-9ebfdcb8741f req-07f89c02-c746-4820-b130-4f5b51cbff5c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:21.233770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-b3c932df-6bd0-44d7-afc4-9ebfdcb8741f req-07f89c02-c746-4820-b130-4f5b51cbff5c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:21.254658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-b3c932df-6bd0-44d7-afc4-9ebfdcb8741f req-07f89c02-c746-4820-b130-4f5b51cbff5c service nova] Creating event network-vif-deleted:630021c2-4dd4-422f-ab2c-4c5771c809e4 for instance d9d41225-bfea-4694-a0a3-1a585d4e8509 on hv-cinder-86009 Oct 03 13:48:21.260287 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-b3c932df-6bd0-44d7-afc4-9ebfdcb8741f req-07f89c02-c746-4820-b130-4f5b51cbff5c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044349 Oct 03 13:48:21.261158 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 549/1101] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:48:21.336065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:21.338130 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:21.355842 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:21.356538 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:21.357038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:21.357907 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:21.358367 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:21.358799 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:21.436533 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f548ccf8c5a14b108aa8b851560139d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e005cbca8874c76bf8ad8f5d336b189', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:21.457636 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-fd05f906-93f6-4046-b77c-70171b23e9fa tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 200 len: 1225 microversion: 2.1 time: 0.126174 Oct 03 13:48:21.461532 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 553/1102] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:21 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:22.486782 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:22.487616 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: d9d41225-bfea-4694-a0a3-1a585d4e8509] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:22.494443 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:22.495173 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:22.495681 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:22.496457 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:22.497000 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:22.497578 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:22.513609 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] HTTP exception thrown: Instance d9d41225-bfea-4694-a0a3-1a585d4e8509 could not be found. Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Request method failure captured: Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 HTTP/1.1 Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuZEvpGYY9KtowMrllQEzXolJsXBgNMRqC0OPz5lO4ORpnSuJCm7Qt3T_z8Pr7ld5ANRgkGeWmPnNvIncSREmYID2C2i2vY9LCIoh9juESCKF2OyxVTmAsHe-fmpRuGPtXtRGd4bjikm4eJAi9KYXOF4K7uDFJMyMPO3QdQiu-R7ZC8 Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:48:22.515464 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: f548ccf8c5a14b108aa8b851560139d0 Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance d9d41225-bfea-4694-a0a3-1a585d4e8509 could not be found. Oct 03 13:48:22.518226 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': 'd9d41225-bfea-4694-a0a3-1a585d4e8509'} Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d41225-bfea-4694-a0a3-1a585d4e8509 could not be found. Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:48:22.519204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d41225-bfea-4694-a0a3-1a585d4e8509 could not be found. Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d41225-bfea-4694-a0a3-1a585d4e8509 could not be found. Oct 03 13:48:22.520973 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:22.523322 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Returning 404 to user: Instance d9d41225-bfea-4694-a0a3-1a585d4e8509 could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:48:22.523602 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-621a8375-607a-41c6-a69b-77fd7fc23916 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509" status: 404 len: 111 microversion: 2.1 time: 0.042002 Oct 03 13:48:22.528372 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 550/1103] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:22 2022] GET /compute/v2.1/servers/d9d41225-bfea-4694-a0a3-1a585d4e8509 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:48:23.379456 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:23.380015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:23.388009 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:23.388794 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:23.389237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:23.390015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:23.390434 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:23.390861 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:23.406105 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] HTTP exception thrown: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Request method failure captured: Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: DELETE /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a HTTP/1.1 Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOuZEvpGYY9KtowMrllQEzXolJsXBgNMRqC0OPz5lO4ORpnSuJCm7Qt3T_z8Pr7ld5ANRgkGeWmPnNvIncSREmYID2C2i2vY9LCIoh9juESCKF2OyxVTmAsHe-fmpRuGPtXtRGd4bjikm4eJAi9KYXOF4K7uDFJMyMPO3QdQiu-R7ZC8 Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:48:23.407876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: f548ccf8c5a14b108aa8b851560139d0 Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.409899 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '846b1cfd-b06e-4af7-9429-bb095737877a'} Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:48:23.413986 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.416015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.418788 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Returning 404 to user: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:48:23.418788 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-30fe3bba-c3cd-45bc-bf70-ef36410df9e8 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "DELETE /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 404 len: 111 microversion: 2.1 time: 0.035832 Oct 03 13:48:23.418788 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 554/1104] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:48:23 2022] DELETE /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:48:23.419214 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:23.419801 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] [instance: 846b1cfd-b06e-4af7-9429-bb095737877a] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:23.427692 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:23.428179 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:23.428844 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:23.429584 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:23.430044 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:23.430469 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:23.445091 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.wsgi [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] HTTP exception thrown: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Request method failure captured: Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: request: GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a HTTP/1.1 Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept: application/json Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Accept-Encoding: identity Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Connection: close Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Length: 0 Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Content-Type: application/json Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Host: 10.222.0.58 Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Openstack-System-Scope: None Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: User-Agent: python-urllib3/1.26.12 Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Auth-Token: gAAAAABjOuZEvpGYY9KtowMrllQEzXolJsXBgNMRqC0OPz5lO4ORpnSuJCm7Qt3T_z8Pr7ld5ANRgkGeWmPnNvIncSREmYID2C2i2vY9LCIoh9juESCKF2OyxVTmAsHe-fmpRuGPtXtRGd4bjikm4eJAi9KYXOF4K7uDFJMyMPO3QdQiu-R7ZC8 Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Id: None Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Domain-Name: None Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Identity-Status: Confirmed Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Is-Admin-Project: True Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Id: default Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Domain-Name: Default Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Project-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Role: reader,member Oct 03 13:48:23.446685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Roles: reader,member Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0e005cbca8874c76bf8ad8f5d336b189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Id: 0e005cbca8874c76bf8ad8f5d336b189 Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-Tenant-Name: tempest-TestVolumeBootPattern-2126467709 Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Id: default Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Domain-Name: Default Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Id: f548ccf8c5a14b108aa8b851560139d0 Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: X-User-Name: tempest-TestVolumeBootPattern-2126467709-project Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: method: > Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: exception: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.448199 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: action_args: {'id': '846b1cfd-b06e-4af7-9429-bb095737877a'} Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:48:23.452770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. Oct 03 13:48:23.454210 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR nova.api.openstack.wsgi Oct 03 13:48:23.455863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Returning 404 to user: Instance 846b1cfd-b06e-4af7-9429-bb095737877a could not be found. {{(pid=120743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:48:23.455863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-31618004-0041-4cbf-bee8-3403f1dd3af3 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a" status: 404 len: 111 microversion: 2.1 time: 0.033150 Oct 03 13:48:23.455863 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 551/1105] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:23 2022] GET /compute/v2.1/servers/846b1cfd-b06e-4af7-9429-bb095737877a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 03 13:48:24.825150 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-49ab287b-632a-4e9a-a62a-7e34d89ddfe7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] Calling method '.version_select at 0x7f7c2194f3a0>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:24.853720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-49ab287b-632a-4e9a-a62a-7e34d89ddfe7 tempest-TestVolumeBootPattern-2126467709 tempest-TestVolumeBootPattern-2126467709-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2088345513" status: 202 len: 0 microversion: 2.1 time: 0.032459 Oct 03 13:48:24.854320 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 555/1106] 10.222.0.58 () {58 vars in 1263 bytes} [Mon Oct 3 13:48:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2088345513 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:48:31.892813 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3bc53e30-95b9-42de-8afa-271025ed079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Action: 'create', calling method: .version_select at 0x7f7c2193b700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1569192262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJe2ppQL9tN6EKijL/aYE41YPuz+/s7jfqDEBudjJ+0GELdpWQwrbo2smz2xEitCyRgATILGk435goymuVgcIvgNtQEt1SJ0GninLTgi/hlXeFh+diOxto9oxsKAsYVNfA=="}} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:31.901546 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:31.912278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-3bc53e30-95b9-42de-8afa-271025ed079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Getting quotas for project 0ccd8015806a42bc81a8cbe3d2cab8d7. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:48:31.916631 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.quota [None req-3bc53e30-95b9-42de-8afa-271025ed079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Getting quotas for user 3de6ff608b8544ef9a1130666b7c3f14 and project 0ccd8015806a42bc81a8cbe3d2cab8d7. Resources: {'key_pairs'} {{(pid=120743) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:48:31.947231 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3bc53e30-95b9-42de-8afa-271025ed079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.272313 Oct 03 13:48:31.948126 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 552/1107] 10.222.0.58 () {60 vars in 1159 bytes} [Mon Oct 3 13:48:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:48:49.741736 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:49.742501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:49.743378 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:48:49.743563 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Mon Oct 3 13:48:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.58) !!! Oct 03 13:48:49.750443 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-991943417", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1569192262", "security_groups": [{"name": "tempest-secgroup-smoke-344248160"}], "networks": [{"uuid": "79bae060-6f35-4161-9986-8642cff331c6"}], "block_device_mapping_v2": [{"uuid": "d127a699-0007-4a88-8bf2-5b1b7eae877c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:49.867462 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.network.neutron [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] validate_networks() for [('79bae060-6f35-4161-9986-8642cff331c6', None, None, None, None, None)] {{(pid=120742) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 03 13:48:50.247938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Flavor limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 03 13:48:50.248362 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Image limits 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 03 13:48:50.249127 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Flavor pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 03 13:48:50.249563 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Image pref 0:0:0 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 03 13:48:50.249976 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.virt.hardware [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 03 13:48:50.258784 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:50.259260 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:50.259716 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:50.260436 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:50.260886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:50.261308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:50.278691 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Getting quotas for project 0ccd8015806a42bc81a8cbe3d2cab8d7. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 03 13:48:50.282599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.quota [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Getting quotas for user 3de6ff608b8544ef9a1130666b7c3f14 and project 0ccd8015806a42bc81a8cbe3d2cab8d7. Resources: {'ram', 'instances', 'cores'} {{(pid=120742) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 03 13:48:50.338419 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Going to run 1 instances... {{(pid=120742) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 03 13:48:50.340522 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d127a699-0007-4a88-8bf2-5b1b7eae877c',volume_size=None,volume_type=None)] {{(pid=120742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 03 13:48:50.471508 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-65a17c3e-569e-4688-8737-9a0746f4b184 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.730901 Oct 03 13:48:50.472104 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 556/1108] 10.222.0.58 () {60 vars in 1147 bytes} [Mon Oct 3 13:48:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 03 13:48:50.480884 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:50.481827 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=4 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:50.482479 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:48:50.483448 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:48:50.483770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: Mon Oct 3 13:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 (ip 10.222.0.58) !!! Oct 03 13:48:50.489919 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-694c565a-3314-40bc-b2a6-cd66ef9fbca3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:50.490530 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-694c565a-3314-40bc-b2a6-cd66ef9fbca3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:50.556773 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-694c565a-3314-40bc-b2a6-cd66ef9fbca3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:50.563630 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-694c565a-3314-40bc-b2a6-cd66ef9fbca3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1088 microversion: 2.1 time: 0.084027 Oct 03 13:48:50.564206 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 553/1109] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:50 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:51.587532 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:51.588147 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:51.595538 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:51.596038 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:51.596496 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:51.597206 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:51.597698 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:51.598135 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:51.662876 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:51.671293 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-805ff836-197c-4fba-b563-f9bb53c73a98 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1186 microversion: 2.1 time: 0.087497 Oct 03 13:48:51.672217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 557/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:51 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:52.698506 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:52.700056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:52.709374 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:52.711098 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:52.711975 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:52.712815 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:52.713739 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:52.714429 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:52.823208 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:52.831920 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-fd67883d-96eb-4ba1-8574-7bb4caf767c2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1204 microversion: 2.1 time: 0.138001 Oct 03 13:48:52.833553 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 554/1111] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:52 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1204 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:53.856449 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:53.857150 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:53.863204 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:53.864433 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:53.865090 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:53.865830 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:53.866290 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:53.866714 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:53.931053 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-1c1aaa78-22c7-4aa2-97d2-e3240fe4c6bf req-55f95bfb-dd3e-4db7-a6b9-c2038587a396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387be01c-1ab3-4d17-8565-235ab70e0114", "tag": "2eb3e7ed-6727-441a-b34a-bf318ebb731c"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:48:53.940686 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-1c1aaa78-22c7-4aa2-97d2-e3240fe4c6bf req-55f95bfb-dd3e-4db7-a6b9-c2038587a396 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:53.941391 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-1c1aaa78-22c7-4aa2-97d2-e3240fe4c6bf req-55f95bfb-dd3e-4db7-a6b9-c2038587a396 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:53.942423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-1c1aaa78-22c7-4aa2-97d2-e3240fe4c6bf req-55f95bfb-dd3e-4db7-a6b9-c2038587a396 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:53.954390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-1c1aaa78-22c7-4aa2-97d2-e3240fe4c6bf req-55f95bfb-dd3e-4db7-a6b9-c2038587a396 service nova] Creating event network-changed:2eb3e7ed-6727-441a-b34a-bf318ebb731c for instance 387be01c-1ab3-4d17-8565-235ab70e0114 on hv-cinder-86009 Oct 03 13:48:53.959972 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-1c1aaa78-22c7-4aa2-97d2-e3240fe4c6bf req-55f95bfb-dd3e-4db7-a6b9-c2038587a396 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181180 Oct 03 13:48:53.960775 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 558/1112] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:48:54.107785 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:54.116691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5ae769fb-44a3-4b64-89cf-9bbd704536af tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.264012 Oct 03 13:48:54.117368 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 555/1113] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:53 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:48:55.141389 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:55.142139 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:55.149789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:55.150286 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:55.150818 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:55.151472 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:55.151932 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:55.152368 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:55.282078 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:55.292827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-11db367b-5610-47bb-bec8-1ac06daf127a tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.155576 Oct 03 13:48:55.293416 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 559/1114] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:55 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:56.319687 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:56.320252 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:56.326664 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:56.327144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:56.327580 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:56.328271 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:56.328722 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:56.329144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:56.461414 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:56.469180 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-61190fb7-cd07-4900-b5fc-f242a9ddc282 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.153477 Oct 03 13:48:56.469789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 556/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:56 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:57.492735 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:57.493355 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:57.500308 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:57.500803 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:57.501248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:57.502073 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:57.502536 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:57.502985 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:57.643713 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:57.651760 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-a039cc24-5fed-4a6c-bfdd-a4b1b6582a7b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.163139 Oct 03 13:48:57.652338 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 560/1116] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:57 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:58.674597 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:58.675162 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:58.682196 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:58.682683 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:58.683124 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:58.683812 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:58.684268 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:58.684691 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:58.819465 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:48:58.827242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4028b2dd-d91b-4c76-bab3-9e77f69b1b79 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.156706 Oct 03 13:48:58.827804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 557/1117] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:58 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:48:59.851607 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:48:59.852214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:48:59.858717 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:59.859201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:59.859646 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:59.860339 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:48:59.860834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:48:59.861261 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:48:59.995249 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:49:00.003274 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0d5e101a-ce63-4fb5-bed3-baf04cdfce58 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.156154 Oct 03 13:49:00.004322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 561/1118] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:48:59 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:49:01.026843 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:49:01.027549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:49:01.030008 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell0:SELECT=2 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:49:01.035144 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:01.035930 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:01.036394 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:01.037092 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:01.037587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:01.038014 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:01.169858 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:49:01.178344 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-6667edba-c203-4e0c-ad06-462514490574 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.155411 Oct 03 13:49:01.178914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 558/1119] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:49:01 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:49:02.201509 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:49:02.202160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:49:02.204128 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=2 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:49:02.204965 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell0:SELECT=6 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:49:02.212937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:02.213422 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:02.213893 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:02.214615 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:02.215068 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:02.215487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:02.347680 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:49:02.355657 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-0e40a324-06d5-4507-ba9d-067116372f2b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.158163 Oct 03 13:49:02.356239 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 562/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:49:02 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:49:03.378036 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:49:03.378622 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:49:03.386716 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:03.386930 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:03.387225 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:03.387926 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:03.388378 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:03.388804 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:03.530010 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:49:03.538062 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-ad04c0ad-1b52-4c40-a4e4-66af653cc39c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.164329 Oct 03 13:49:03.538645 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 559/1121] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:49:03 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:49:04.561623 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:49:04.562303 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:49:04.569794 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:04.570854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:04.570854 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:04.571463 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:04.571924 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:04.572357 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:04.709621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:49:04.718118 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-27f6dd74-61a9-46c7-bd4f-bf34ec920978 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.160543 Oct 03 13:49:04.718694 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 563/1122] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:49:04 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:49:04.888066 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-dfda1df2-aedf-4e5c-be23-dc371c13bb27 req-494da055-d614-48f0-a3fa-9991fb3e083c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387be01c-1ab3-4d17-8565-235ab70e0114", "name": "network-vif-plugged", "status": "completed", "tag": "2eb3e7ed-6727-441a-b34a-bf318ebb731c"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:49:04.897866 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-dfda1df2-aedf-4e5c-be23-dc371c13bb27 req-494da055-d614-48f0-a3fa-9991fb3e083c service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:04.898278 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-dfda1df2-aedf-4e5c-be23-dc371c13bb27 req-494da055-d614-48f0-a3fa-9991fb3e083c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:04.898710 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-dfda1df2-aedf-4e5c-be23-dc371c13bb27 req-494da055-d614-48f0-a3fa-9991fb3e083c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:04.909983 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-dfda1df2-aedf-4e5c-be23-dc371c13bb27 req-494da055-d614-48f0-a3fa-9991fb3e083c service nova] Creating event network-vif-plugged:2eb3e7ed-6727-441a-b34a-bf318ebb731c for instance 387be01c-1ab3-4d17-8565-235ab70e0114 on hv-cinder-86009 Oct 03 13:49:04.915031 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-dfda1df2-aedf-4e5c-be23-dc371c13bb27 req-494da055-d614-48f0-a3fa-9991fb3e083c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115354 Oct 03 13:49:04.915714 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 560/1123] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:49:05.740820 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:49:05.741441 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:49:05.747874 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:05.748364 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:05.749071 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:05.749800 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:05.750272 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:05.750702 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:05.880591 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:49:05.888228 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-eb35bf19-18e6-4e29-b4da-0312bb32e554 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1259 microversion: 2.1 time: 0.151817 Oct 03 13:49:05.888790 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 564/1124] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:49:05 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:49:06.912390 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:49:06.913036 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:49:06.919189 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:06.919674 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:06.920115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:06.920808 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:06.921293 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:06.921755 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:07.055051 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:49:07.062774 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4ca55852-ab09-4c0f-84d4-633c5d2b273c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1442 microversion: 2.1 time: 0.155819 Oct 03 13:49:07.063353 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 561/1125] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:49:06 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:49:07.085437 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:49:07.086075 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:49:07.092405 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:07.092886 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:07.093328 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:07.094048 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:07.094510 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:07.094937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:07.227667 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:49:07.235412 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-3b39ab14-411c-4367-b691-19a62b1ab914 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1442 microversion: 2.1 time: 0.154346 Oct 03 13:49:07.235981 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 565/1126] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:49:07 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:49:09.036800 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-5fd51aa3-de5a-4eb1-b351-3bb106fa9549 req-c7155ad4-e184-4fce-a2c9-0432816bbb07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387be01c-1ab3-4d17-8565-235ab70e0114", "tag": "2eb3e7ed-6727-441a-b34a-bf318ebb731c"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:49:09.046853 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5fd51aa3-de5a-4eb1-b351-3bb106fa9549 req-c7155ad4-e184-4fce-a2c9-0432816bbb07 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:49:09.047334 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5fd51aa3-de5a-4eb1-b351-3bb106fa9549 req-c7155ad4-e184-4fce-a2c9-0432816bbb07 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:49:09.047766 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-5fd51aa3-de5a-4eb1-b351-3bb106fa9549 req-c7155ad4-e184-4fce-a2c9-0432816bbb07 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:49:09.059549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-5fd51aa3-de5a-4eb1-b351-3bb106fa9549 req-c7155ad4-e184-4fce-a2c9-0432816bbb07 service nova] Creating event network-changed:2eb3e7ed-6727-441a-b34a-bf318ebb731c for instance 387be01c-1ab3-4d17-8565-235ab70e0114 on hv-cinder-86009 Oct 03 13:49:09.064535 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-5fd51aa3-de5a-4eb1-b351-3bb106fa9549 req-c7155ad4-e184-4fce-a2c9-0432816bbb07 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031421 Oct 03 13:49:09.065335 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 562/1127] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:51:08.028112 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:51:08.028778 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=52 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:51:08.030227 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:51:08.030423 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Mon Oct 3 13:51:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114/action (ip 10.222.0.58) !!! Oct 03 13:51:08.036207 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:51:08.036744 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:08.045690 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:08.046179 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:08.046621 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:08.047318 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:08.047782 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:08.048211 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:08.072248 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.objects.instance [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lazy-loading 'flavor' on Instance uuid 387be01c-1ab3-4d17-8565-235ab70e0114 {{(pid=120742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 03 13:51:08.151160 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-714d0fa4-3aa6-476c-a44e-b000d5a64880 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "POST /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114/action" status: 202 len: 0 microversion: 2.1 time: 0.124513 Oct 03 13:51:08.151773 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 566/1128] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:51:08 2022] POST /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:51:08.158161 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR oslo.messaging._drivers.impl_rabbit [-] [07e77f4a-fbc9-47c9-a228-3a068883afd9] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 13:51:08.158986 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=22 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:51:08.159499 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=46 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:51:08.160694 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 03 13:51:08.169315 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:08.170221 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:08.177641 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:08.178135 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:08.178577 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:08.179286 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:08.180260 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:08.180690 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:08.402056 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:08.409872 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-98c08d55-92a4-4ad6-b707-294ee1fe1860 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.253529 Oct 03 13:51:08.410442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 563/1129] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:08 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:09.434817 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:09.435498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:09.441638 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:09.442118 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:09.442555 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:09.443233 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:09.443682 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:09.444126 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:09.647005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:09.655306 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-6a135b59-f58c-418b-8ed9-d86e4fce5e24 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.225369 Oct 03 13:51:09.655887 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 567/1130] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:09 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:10.681135 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:10.681757 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:10.689202 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:10.689549 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:10.689990 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:10.690689 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:10.691141 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:10.691565 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:10.708748 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [-] [07e77f4a-fbc9-47c9-a228-3a068883afd9] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48102. Oct 03 13:51:10.829309 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:10.838015 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-5928854f-2712-4008-bccf-41ad80ed26e1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.161463 Oct 03 13:51:10.838632 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 564/1131] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:10 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:11.861328 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:11.861973 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:11.869077 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:11.869590 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:11.870032 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:11.870753 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:11.871210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:11.871637 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:12.006231 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:12.014358 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-e22817e1-a3d6-440c-aff3-1bdca066e627 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.156654 Oct 03 13:51:12.014698 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 568/1132] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:11 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:13.038079 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:13.038698 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:13.045911 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:13.046387 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:13.046816 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:13.047510 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:13.047958 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:13.048370 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:13.182333 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:13.190726 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2ae321a1-342d-4999-b676-aef587eaaef1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.156526 Oct 03 13:51:13.191364 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 565/1133] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:13 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:14.214566 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:14.215189 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:14.221665 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:14.222151 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:14.222632 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:14.223322 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:14.223779 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:14.224208 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:14.363739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:14.371678 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-da1b3331-b5a3-4ce2-96a1-b0fd1d66b569 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.161526 Oct 03 13:51:14.372243 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 569/1134] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:14 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:15.395391 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:15.396012 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:15.403168 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:15.403648 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:15.404080 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:15.404794 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:15.405216 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:15.405662 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:15.535823 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:15.544250 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-18bec20a-1cb2-4059-8cfb-6411e4469858 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.152636 Oct 03 13:51:15.544831 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 566/1135] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:15 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:16.567620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:16.568288 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:16.575291 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:16.575778 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:16.576217 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:16.576917 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:16.577368 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:16.577827 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:16.717324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:16.725087 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-09a5a4f9-18ed-4d2f-a141-db932350fcb6 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.161422 Oct 03 13:51:16.725688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 570/1136] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:16 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:17.748511 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:17.749115 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:17.755655 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:17.756145 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:17.756587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:17.757279 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:17.758326 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:17.758714 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:17.894914 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:17.902952 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-af78267f-03d1-426e-b31c-c8a9be3857cd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.158583 Oct 03 13:51:17.903560 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 567/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:17 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:18.930507 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:18.931143 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:18.939198 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:18.939688 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:18.940131 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:18.940837 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:18.941324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:18.941739 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:19.081863 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:19.089744 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-fa8eccf0-b993-423b-a54c-5407ae5af8a3 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.163784 Oct 03 13:51:19.090325 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 571/1138] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:18 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:20.114733 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:20.115410 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:20.123657 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:20.124149 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:20.124591 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:20.125304 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:20.125789 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:20.126220 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:20.263586 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:20.271442 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-4390af91-8f6d-44fa-b9c9-f7b01e8267ae tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.161182 Oct 03 13:51:20.272019 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 568/1139] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:20 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:21.295189 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:21.295745 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:21.302119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:21.302597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:21.303033 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:21.303753 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:21.304201 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:21.304789 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:21.436128 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:21.443961 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-32f1b735-35a3-4127-ab94-785faf5e954b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1567 microversion: 2.1 time: 0.152825 Oct 03 13:51:21.444547 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 572/1140] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:21 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:21.467923 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:51:21.468786 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:21.475486 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:21.475972 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:21.476501 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:21.477544 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:21.478005 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:21.478430 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:21.571862 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120743) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 03 13:51:21.639963 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f7ece97f-56c3-4216-9a6a-351431f91bb2 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "POST /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114/action" status: 202 len: 0 microversion: 2.1 time: 0.175944 Oct 03 13:51:21.640868 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 569/1141] 10.222.0.58 () {60 vars in 1278 bytes} [Mon Oct 3 13:51:21 2022] POST /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 03 13:51:21.648965 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:21.649609 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:21.655605 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:21.656093 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:21.656528 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:21.657220 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:21.657918 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:21.658328 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:21.832840 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:21.844051 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-815dc361-b846-4c7e-b3cb-98b6dd759070 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1515 microversion: 2.1 time: 0.198594 Oct 03 13:51:21.844938 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 573/1142] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:21 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:22.869044 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:22.869680 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:22.876875 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:22.877365 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:22.877839 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:22.878543 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:22.878998 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:22.879440 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:23.031985 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:23.040119 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-3e989c40-e4a0-4688-9c8c-4f0f87691243 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1517 microversion: 2.1 time: 0.175828 Oct 03 13:51:23.040685 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 570/1143] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:22 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:23.350880 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-e7f54dc2-fa12-410a-bf90-678d12d62f44 req-c656bfa8-0aa2-472f-9c90-2dfd11aff211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387be01c-1ab3-4d17-8565-235ab70e0114", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb3e7ed-6727-441a-b34a-bf318ebb731c"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:51:23.361697 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e7f54dc2-fa12-410a-bf90-678d12d62f44 req-c656bfa8-0aa2-472f-9c90-2dfd11aff211 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:23.362257 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e7f54dc2-fa12-410a-bf90-678d12d62f44 req-c656bfa8-0aa2-472f-9c90-2dfd11aff211 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:23.362921 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-e7f54dc2-fa12-410a-bf90-678d12d62f44 req-c656bfa8-0aa2-472f-9c90-2dfd11aff211 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:23.374937 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-e7f54dc2-fa12-410a-bf90-678d12d62f44 req-c656bfa8-0aa2-472f-9c90-2dfd11aff211 service nova] Creating event network-vif-unplugged:2eb3e7ed-6727-441a-b34a-bf318ebb731c for instance 387be01c-1ab3-4d17-8565-235ab70e0114 on hv-cinder-86009 Oct 03 13:51:23.380214 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-e7f54dc2-fa12-410a-bf90-678d12d62f44 req-c656bfa8-0aa2-472f-9c90-2dfd11aff211 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033129 Oct 03 13:51:23.380898 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 574/1144] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:51:24.063402 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:24.063954 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:24.070447 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:24.070925 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:24.071358 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:24.072036 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:24.072485 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:24.072905 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:24.206207 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:24.214535 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-19b98230-8109-4142-8a56-c0a908960edd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.155052 Oct 03 13:51:24.215105 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 571/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:24 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:25.239483 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:25.240185 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:25.246568 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:25.247055 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:25.247494 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:25.248446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:25.248900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:25.249323 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:25.384193 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:25.392255 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b7f25c06-0b0c-4275-a7ba-2fb423d2488c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.157517 Oct 03 13:51:25.392830 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 575/1146] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:25 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:26.415901 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:26.416466 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:26.422895 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:26.423380 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:26.423819 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:26.424510 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:26.424962 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:26.425383 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:26.555979 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:26.563689 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-b464ecfc-3646-41cb-aaad-c5bf47103580 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.152535 Oct 03 13:51:26.564242 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 572/1147] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:26 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:27.588191 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:27.588756 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:27.595108 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:27.595582 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:27.596019 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:27.596706 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:27.597151 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:27.597599 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:27.733900 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:27.741737 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-b76c6d27-e6c7-43e8-89d1-533849e84206 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.158071 Oct 03 13:51:27.742390 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 576/1148] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:27 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:28.766359 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:28.767089 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:28.774156 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:28.774640 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:28.775110 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:28.775778 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:28.776236 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:28.776658 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:28.912333 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:28.920319 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-7b6718d8-f2bd-4a58-8c86-86c539316615 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.158285 Oct 03 13:51:28.920888 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 573/1149] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:28 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:29.946995 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:29.948047 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:29.955829 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:29.956324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:29.956769 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:29.957493 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:29.957956 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:29.958438 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:30.129045 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:30.137594 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-79f28027-61ae-42a3-b698-322fb25b4b3c tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.197526 Oct 03 13:51:30.138187 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 577/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:29 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:51:31.164729 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:31.165518 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:31.171942 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:31.172428 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:31.172866 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:31.173587 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:31.174045 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:31.174470 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:31.311854 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:31.321227 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-d9b7a487-1915-46fd-a7d7-68c274227aa5 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.160660 Oct 03 13:51:31.321912 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 574/1151] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:31 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:32.345268 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:32.345913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:32.353163 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:32.353679 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:32.354139 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:32.354807 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:32.355254 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:32.355674 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:32.486764 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:32.494902 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-df4f644b-cde8-4376-885b-484baa77a6fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.153437 Oct 03 13:51:32.495513 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 578/1152] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:32 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:33.401369 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [req-9e4faac2-4dfe-4f07-aa29-c06b5aadd32a req-d155107c-c890-4912-8422-1c1f2d1d63f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387be01c-1ab3-4d17-8565-235ab70e0114", "name": "network-vif-plugged", "status": "completed", "tag": "2eb3e7ed-6727-441a-b34a-bf318ebb731c"}]} {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:51:33.411525 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-9e4faac2-4dfe-4f07-aa29-c06b5aadd32a req-d155107c-c890-4912-8422-1c1f2d1d63f3 service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:33.412011 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-9e4faac2-4dfe-4f07-aa29-c06b5aadd32a req-d155107c-c890-4912-8422-1c1f2d1d63f3 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:33.412474 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [req-9e4faac2-4dfe-4f07-aa29-c06b5aadd32a req-d155107c-c890-4912-8422-1c1f2d1d63f3 service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:33.424725 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.compute.server_external_events [req-9e4faac2-4dfe-4f07-aa29-c06b5aadd32a req-d155107c-c890-4912-8422-1c1f2d1d63f3 service nova] Creating event network-vif-plugged:2eb3e7ed-6727-441a-b34a-bf318ebb731c for instance 387be01c-1ab3-4d17-8565-235ab70e0114 on hv-cinder-86009 Oct 03 13:51:33.428249 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: ERROR oslo.messaging._drivers.impl_rabbit [req-9e4faac2-4dfe-4f07-aa29-c06b5aadd32a req-d155107c-c890-4912-8422-1c1f2d1d63f3 service nova] [ce579a5a-1b3f-4d82-bcb8-049e0f09241a] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 03 13:51:33.519271 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:33.519869 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:33.526395 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:33.526884 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:33.527324 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:33.528018 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:33.528473 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:33.528901 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:33.670872 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:33.679039 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-ea73a376-826c-4baa-aab0-d62a7da82163 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.163385 Oct 03 13:51:33.679620 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 579/1153] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:33 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 03 13:51:34.435458 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO oslo.messaging._drivers.impl_rabbit [req-9e4faac2-4dfe-4f07-aa29-c06b5aadd32a req-d155107c-c890-4912-8422-1c1f2d1d63f3 service nova] [ce579a5a-1b3f-4d82-bcb8-049e0f09241a] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48168. Oct 03 13:51:34.438980 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [req-9e4faac2-4dfe-4f07-aa29-c06b5aadd32a req-d155107c-c890-4912-8422-1c1f2d1d63f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041439 Oct 03 13:51:34.439642 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 575/1154] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 03 13:51:34.703446 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:34.704411 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:34.711145 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:34.711802 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:34.712233 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:34.712930 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:34.713384 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:34.713834 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:34.845870 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:34.854343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-248393c8-bb96-497b-8809-d11cca2421c1 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.154770 Oct 03 13:51:34.854913 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 580/1155] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:34 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:35.879357 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:35.880065 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:35.886993 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:35.887537 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:35.887976 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:35.888679 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:35.889139 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:35.889594 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:36.026131 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:36.033922 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-9e20efc7-a7cf-44f5-a064-7bd766b1454b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1573 microversion: 2.1 time: 0.159373 Oct 03 13:51:36.034489 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 576/1156] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:35 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:51:37.057343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:51:37.058005 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:51:37.066149 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:37.066722 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:37.067164 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:37.068031 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:51:37.068487 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:51:37.068909 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:51:37.073754 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:51:37.206252 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:51:37.214720 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-82dc9a69-21e8-4f29-bb25-d8518c61e7fa tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1560 microversion: 2.1 time: 0.161867 Oct 03 13:51:37.215296 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 581/1157] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:51:37 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:52:57.425191 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:52:57.426127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG dbcounter [-] [120743] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:52:57.428469 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_api:SELECT=32 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:52:57.430878 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG dbcounter [-] [120742] Writing DB stats nova_cell1:SELECT=4 {{(pid=120742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 13:52:57.432064 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:52:57.432570 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:52:57.433219 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 03 13:52:57.433365 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Mon Oct 3 13:52:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Oct 03 13:52:57.441520 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:57.442399 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:57.442833 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:52:57.443527 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:57.443977 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:57.444391 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:52:57.448613 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-bde101ef-f7cc-44a2-96d7-7f2561efeec6 req-ced017fa-c64f-41a7-aa58-032e43e9b60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387be01c-1ab3-4d17-8565-235ab70e0114", "tag": "2eb3e7ed-6727-441a-b34a-bf318ebb731c"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:52:57.458578 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-bde101ef-f7cc-44a2-96d7-7f2561efeec6 req-ced017fa-c64f-41a7-aa58-032e43e9b60c service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:57.459065 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-bde101ef-f7cc-44a2-96d7-7f2561efeec6 req-ced017fa-c64f-41a7-aa58-032e43e9b60c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:57.459501 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-bde101ef-f7cc-44a2-96d7-7f2561efeec6 req-ced017fa-c64f-41a7-aa58-032e43e9b60c service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:52:57.471228 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Going to try to terminate instance {{(pid=120743) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 03 13:52:57.471460 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-bde101ef-f7cc-44a2-96d7-7f2561efeec6 req-ced017fa-c64f-41a7-aa58-032e43e9b60c service nova] Creating event network-changed:2eb3e7ed-6727-441a-b34a-bf318ebb731c for instance 387be01c-1ab3-4d17-8565-235ab70e0114 on hv-cinder-86009 Oct 03 13:52:57.477288 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-bde101ef-f7cc-44a2-96d7-7f2561efeec6 req-ced017fa-c64f-41a7-aa58-032e43e9b60c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050626 Oct 03 13:52:57.478302 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 582/1158] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:52:57.554750 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-902d710c-acf4-4a14-a16a-ce516ebeb077 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "DELETE /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 204 len: 0 microversion: 2.1 time: 0.130713 Oct 03 13:52:57.559252 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 577/1159] 10.222.0.58 () {58 vars in 1239 bytes} [Mon Oct 3 13:52:57 2022] DELETE /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 03 13:52:57.571597 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:52:57.573767 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:52:57.580626 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:57.581119 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:57.581608 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:52:57.582317 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:57.582911 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:57.583343 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:52:57.729806 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.policy [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120742) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:52:57.737633 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-9702c939-e618-44ca-976e-37fc886b2ffd tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.174570 Oct 03 13:52:57.738210 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 583/1160] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:52:57 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:52:58.763035 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:52:58.763653 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:52:58.770140 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:58.770617 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:58.771054 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:52:58.771740 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:58.772189 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:58.772605 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:52:58.958779 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:52:58.967515 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-2cf7397b-e430-4c17-a7cb-260eefe5a47d tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1566 microversion: 2.1 time: 0.208840 Oct 03 13:52:58.968130 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 578/1161] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:52:58 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:52:59.818992 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [req-148bbe00-b024-47c9-a934-9f226557651e req-012f5203-2938-4f64-ba44-95e203ef1aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387be01c-1ab3-4d17-8565-235ab70e0114", "name": "network-vif-deleted", "tag": "2eb3e7ed-6727-441a-b34a-bf318ebb731c"}]} {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 03 13:52:59.835015 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-148bbe00-b024-47c9-a934-9f226557651e req-012f5203-2938-4f64-ba44-95e203ef1aaf service nova] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:59.836094 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-148bbe00-b024-47c9-a934-9f226557651e req-012f5203-2938-4f64-ba44-95e203ef1aaf service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:59.836546 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [req-148bbe00-b024-47c9-a934-9f226557651e req-012f5203-2938-4f64-ba44-95e203ef1aaf service nova] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:52:59.848376 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.compute.server_external_events [req-148bbe00-b024-47c9-a934-9f226557651e req-012f5203-2938-4f64-ba44-95e203ef1aaf service nova] Creating event network-vif-deleted:2eb3e7ed-6727-441a-b34a-bf318ebb731c for instance 387be01c-1ab3-4d17-8565-235ab70e0114 on hv-cinder-86009 Oct 03 13:52:59.854170 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [req-148bbe00-b024-47c9-a934-9f226557651e req-012f5203-2938-4f64-ba44-95e203ef1aaf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038888 Oct 03 13:52:59.854936 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 584/1162] 10.222.0.58 () {64 vars in 1317 bytes} [Mon Oct 3 13:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 03 13:52:59.991053 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:52:59.991800 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.compute.api [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120743) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:52:59.998845 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:52:59.999333 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:52:59.999770 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:53:00.000462 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:53:00.000918 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:53:00.001347 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG oslo_concurrency.lockutils [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:53:00.062248 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.policy [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de6ff608b8544ef9a1130666b7c3f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ccd8015806a42bc81a8cbe3d2cab8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120743) authorize /opt/stack/nova/nova/policy.py:199}} Oct 03 13:53:00.069982 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-567c3d14-1e85-42a3-800b-f6967d6b079b tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 200 len: 1219 microversion: 2.1 time: 0.082860 Oct 03 13:53:00.071337 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 579/1163] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:52:59 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 03 13:53:01.093858 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '>' {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:53:01.094571 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.compute.api [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] [instance: 387be01c-1ab3-4d17-8565-235ab70e0114] Fetching instance by UUID {{(pid=120742) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 03 13:53:01.100800 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:53:01.101344 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:53:01.101809 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:53:01.102498 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Acquiring lock "4538db60-5857-474d-9312-77364756bb5d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 03 13:53:01.102954 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 03 13:53:01.103384 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG oslo_concurrency.lockutils [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Lock "4538db60-5857-474d-9312-77364756bb5d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 03 13:53:01.116675 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.wsgi [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] HTTP exception thrown: Instance 387be01c-1ab3-4d17-8565-235ab70e0114 could not be found. Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Request method failure captured: Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: request: GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 HTTP/1.1 Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept: application/json Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Accept-Encoding: identity Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Connection: close Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Length: 0 Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Content-Type: application/json Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Host: 10.222.0.58 Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: Openstack-System-Scope: None Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: User-Agent: python-urllib3/1.26.12 Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Auth-Token: gAAAAABjOugo8ouQmvfWtxMcTxVsCGAPEwQsd6aNmQ9EH9tIrGbRuqh_3du3TDWiy2JF7K6KCg2UXtnFoNgb0VlHtg1RPhz-PuQorYD6fTlrkoyUnsWUaGru-REIhMMKA4Vche8k-_vAtc_8IE_rPHPgM_7MycOWd0veZDnS94FfWkecor7JqK4 Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Id: None Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Domain-Name: None Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Identity-Status: Confirmed Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Is-Admin-Project: True Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Id: default Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Domain-Name: Default Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Id: 0ccd8015806a42bc81a8cbe3d2cab8d7 Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Project-Name: tempest-TestShelveInstance-514247157 Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Role: reader,member Oct 03 13:53:01.118449 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Roles: reader,member Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0ccd8015806a42bc81a8cbe3d2cab8d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0ccd8015806a42bc81a8cbe3d2cab8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0ccd8015806a42bc81a8cbe3d2cab8d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0ccd8015806a42bc81a8cbe3d2cab8d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}] Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant: tempest-TestShelveInstance-514247157 Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Id: 0ccd8015806a42bc81a8cbe3d2cab8d7 Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-Tenant-Name: tempest-TestShelveInstance-514247157 Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User: tempest-TestShelveInstance-514247157-project Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Id: default Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Domain-Name: Default Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Id: 3de6ff608b8544ef9a1130666b7c3f14 Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: X-User-Name: tempest-TestShelveInstance-514247157-project Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: method: > Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: exception: Instance 387be01c-1ab3-4d17-8565-235ab70e0114 could not be found. Oct 03 13:53:01.120237 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: action_args: {'id': '387be01c-1ab3-4d17-8565-235ab70e0114'} Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: {{(pid=120742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387be01c-1ab3-4d17-8565-235ab70e0114 could not be found. Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 03 13:53:01.121520 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387be01c-1ab3-4d17-8565-235ab70e0114 could not be found. Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387be01c-1ab3-4d17-8565-235ab70e0114 could not be found. Oct 03 13:53:01.123964 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: ERROR nova.api.openstack.wsgi Oct 03 13:53:01.125499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: DEBUG nova.api.openstack.wsgi [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Returning 404 to user: Instance 387be01c-1ab3-4d17-8565-235ab70e0114 could not be found. {{(pid=120742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 03 13:53:01.125499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: INFO nova.api.openstack.requestlog [None req-326d9df9-c029-40fe-b79f-fa665b84e589 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114" status: 404 len: 111 microversion: 2.1 time: 0.030737 Oct 03 13:53:01.125499 dv-cinder-860090-1-iscsi devstack@n-api.service[120742]: [pid: 120742|app: 0|req: 585/1164] 10.222.0.58 () {58 vars in 1236 bytes} [Mon Oct 3 13:53:01 2022] GET /compute/v2.1/servers/387be01c-1ab3-4d17-8565-235ab70e0114 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 03 13:53:01.282368 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: DEBUG nova.api.openstack.wsgi [None req-f93bd602-17c7-41c9-bc55-34d619ca6160 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] Calling method '.version_select at 0x7f7c21984af0>' {{(pid=120743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 03 13:53:01.305127 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: INFO nova.api.openstack.requestlog [None req-f93bd602-17c7-41c9-bc55-34d619ca6160 tempest-TestShelveInstance-514247157 tempest-TestShelveInstance-514247157-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1569192262" status: 202 len: 0 microversion: 2.1 time: 0.026624 Oct 03 13:53:01.306106 dv-cinder-860090-1-iscsi devstack@n-api.service[120743]: [pid: 120743|app: 0|req: 580/1165] 10.222.0.58 () {58 vars in 1254 bytes} [Mon Oct 3 13:53:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1569192262 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)